MURAL - Maynooth University Research Archive Library



    Q-Learning for Cognitive Radios


    Hosey, Neil, Bergin, Susan, Macaluso, Irene and O'Donoghue, Diarmuid (2009) Q-Learning for Cognitive Radios. In: Proceedings of the China-Ireland Information and Communications Technologies Conference (CIICT 2009). National University of Ireland Maynooth. ISBN 9780901519672

    [thumbnail of NH_Q-Learning.pdf] PDF
    NH_Q-Learning.pdf

    Download (501kB)

    Abstract

    Machine Learning approaches such as Reinforcement Learning (RL) can be used to solve problems such as spectrum sensing and channel allocation in the cognitive radio domain. These approaches have been applied to other similiar domains such as in mobile telephone networks and have shown greater performance than the static channel allocation schemes used. The objective of this research is to use an RL technique known as Q-Learning to provide a possible solution for allocating channels in a wireless network containing independent cognitive nodes. Q-Learning is an attractive algorithm for such a problem because of the low computational demands per iteration. Many or the current proposed techniques suggest using a negotiation policy between two nodes to decide on which channel each may use, however a considerable problem with this is the overhead involved in the negotiation involved between the nodes. This paper suggests an approach where each node acts as an individual independant node, with virtually no collaboration with the other nodes. Results have shown that using such a technique gives fast convergence on an optimal solution when correct rates are chosen. It has also shown that the algorithm is very scalable, in that as the network grows, the state-action space does not grow sufficiently to cause major memory or computational demands
    Item Type: Book Section
    Additional Information: This work has been carried out with the support of Science Foundation Ireland (SFI) through the Centre for Telecommunication Value Chain Research (CTVR) and the Institute of Microelectronics and Wireless Systems at the National University of Ireland, Maynooth
    Keywords: Q-Learning; Cognitive Radios; Machine Learning; Reinforcement Learning;
    Academic Unit: Faculty of Science and Engineering > Computer Science
    Item ID: 2467
    Depositing User: CS Editor
    Date Deposited: 08 Mar 2011 12:42
    Journal or Publication Title: Proceedings of the China-Ireland Information and Communications Technology Conference (CIICT 2009). ISBN 9780901519672
    Publisher: National University of Ireland Maynooth
    Refereed: Yes
    Funders: Science Foundation Ireland, Centre for Telecommunication Value Chain Research, Institute of Microelectronics and Wireless Systems
    Related URLs:
    URI: https://mural.maynoothuniversity.ie/id/eprint/2467
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads