Hosey, Neil, Bergin, Susan, Macaluso, Irene and O'Donoghue, Diarmuid (2009) Q-Learning for Cognitive Radios. In: Proceedings of the China-Ireland Information and Communications Technologies Conference (CIICT 2009). National University of Ireland Maynooth. ISBN 9780901519672
PDF
NH_Q-Learning.pdf
Download (501kB)
NH_Q-Learning.pdf
Download (501kB)
Abstract
Machine Learning approaches such as Reinforcement
Learning (RL) can be used to solve problems such as
spectrum sensing and channel allocation in the cognitive radio
domain. These approaches have been applied to other similiar
domains such as in mobile telephone networks and have shown
greater performance than the static channel allocation
schemes used.
The objective of this research is to use an RL technique
known as Q-Learning to provide a possible solution for allocating
channels in a wireless network containing independent cognitive
nodes. Q-Learning is an attractive algorithm for such a problem
because of the low computational demands per iteration. Many
or the current proposed techniques suggest using a negotiation
policy between two nodes to decide on which channel each may
use, however a considerable problem with this is the overhead
involved in the negotiation involved between the nodes. This
paper suggests an approach where each node acts as an individual
independant node, with virtually no collaboration with the other
nodes.
Results have shown that using such a technique gives fast
convergence on an optimal solution when correct rates are chosen.
It has also shown that the algorithm is very scalable, in that as the
network grows, the state-action space does not grow sufficiently
to cause major memory or computational demands
Item Type: | Book Section |
---|---|
Additional Information: | This work has been carried out with the support of Science Foundation Ireland (SFI) through the Centre for Telecommunication Value Chain Research (CTVR) and the Institute of Microelectronics and Wireless Systems at the National University of Ireland, Maynooth |
Keywords: | Q-Learning; Cognitive Radios; Machine Learning; Reinforcement Learning; |
Academic Unit: | Faculty of Science and Engineering > Computer Science |
Item ID: | 2467 |
Depositing User: | CS Editor |
Date Deposited: | 08 Mar 2011 12:42 |
Journal or Publication Title: | Proceedings of the China-Ireland Information and Communications Technology Conference (CIICT 2009). ISBN 9780901519672 |
Publisher: | National University of Ireland Maynooth |
Refereed: | Yes |
Funders: | Science Foundation Ireland, Centre for Telecommunication Value Chain Research, Institute of Microelectronics and Wireless Systems |
Related URLs: | |
URI: | https://mural.maynoothuniversity.ie/id/eprint/2467 |
Use Licence: | This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here |
Repository Staff Only (login required)
Downloads
Downloads per month over past year