Hosey, Neil and Bergin, Susan and Macaluso, Irene and O'Donoghue, Diarmuid (2009) Q-Learning for Cognitive Radios. In: Proceedings of the China-Ireland Information and Communications Technologies Conference (CIICT 2009). National University of Ireland Maynooth. ISBN 9780901519672

Download (501kB)

Abstract

Machine Learning approaches such as Reinforcement Learning (RL) can be used to solve problems such as spectrum sensing and channel allocation in the cognitive radio domain. These approaches have been applied to other similiar domains such as in mobile telephone networks and have shown greater performance than the static channel allocation schemes used. The objective of this research is to use an RL technique known as Q-Learning to provide a possible solution for allocating channels in a wireless network containing independent cognitive nodes. Q-Learning is an attractive algorithm for such a problem because of the low computational demands per iteration. Many or the current proposed techniques suggest using a negotiation policy between two nodes to decide on which channel each may use, however a considerable problem with this is the overhead involved in the negotiation involved between the nodes. This paper suggests an approach where each node acts as an individual independant node, with virtually no collaboration with the other nodes. Results have shown that using such a technique gives fast convergence on an optimal solution when correct rates are chosen. It has also shown that the algorithm is very scalable, in that as the network grows, the state-action space does not grow sufficiently to cause major memory or computational demands

Item Type:	Book Section
Additional Information:	This work has been carried out with the support of Science Foundation Ireland (SFI) through the Centre for Telecommunication Value Chain Research (CTVR) and the Institute of Microelectronics and Wireless Systems at the National University of Ireland, Maynooth
Keywords:	Q-Learning; Cognitive Radios; Machine Learning; Reinforcement Learning;
Academic Unit:	Faculty of Science and Engineering > Computer Science
Item ID:	2467
Depositing User:	CS Editor
Date Deposited:	08 Mar 2011 12:42
Journal or Publication Title:	Proceedings of the China-Ireland Information and Communications Technology Conference (CIICT 2009). ISBN 9780901519672
Publisher:	National University of Ireland Maynooth
Refereed:	Yes
Funders:	Science Foundation Ireland, Centre for Telecommunication Value Chain Research, Institute of Microelectronics and Wireless Systems
URI:	http://elm.eeng.dcu.ie/ciict/2009/procee...
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads