Channel Exploration and Exploitation with Imperfect Spectrum Sensing in Cognitive Radio Networks
Authors:
- Zhou ZhangZZZhou Zhang
- Hai JiangHJHai Jiang
- Peng TanPTPeng Tan
- Jim SlevinskyJSJim Slevinsky
Preprint
Abstract
In this paper, the problem of opportunistic channel sensing and access in cognitive radio networks when the sensing is imperfect and a secondary user has limited traffic to send at a time is investigated. Primary users' statistical information is assumed to be unknown, and therefore, a secondary user needs to learn the information online during channel sensing and access process, which means learning loss, also referred to as regret, is inevitable. In this research, the case when all potential channels can be sensed simultaneously is investigated first. The channel access process is modeled as a multi-armed bandit problem with side observation. And channel access rules are derived and theoretically proved to have asymptotically finite regret. Then the case when the secondary user can sense only a limited number of channels at a time is investigated. The channel sensing and access process is modeled as a bi-level multi-armed bandit problem. It is shown that any adaptive rule has at least logarithmic regret. Then we derive channel sensing and access rules and theoretically prove they have logarithmic regret asymptotically and with finite time. The effectiveness of the derived rules is validated by computer simulation.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Distributed Algorithms for Learning and Cognitive Medium Access with Logarithmic RegretIEEE Journal on Selected Areas in Communications, 2011
- Dynamic Resource Allocation in Cognitive Radio NetworksIEEE Signal Processing Magazine, 2010
- On Ergodic Sum Capacity of Fading Cognitive Multiple-Access and Broadcast ChannelsIEEE Transactions on Information Theory, 2009
- Optimal selection of channel sensing order in cognitive radioIEEE Transactions on Wireless Communications, 2009
- Bandit problems with side observationsIEEE Transactions on Automatic Control, 2005
- Cognitive radio: brain-empowered wireless communicationsIEEE Journal on Selected Areas in Communications, 2005
- Finite-time Analysis of the Multiarmed Bandit ProblemMachine Learning, 2002
- Cognitive radio: making software radios more personalIEEE Wireless Communications, 1999
- Asymptotically efficient allocation rules for the multiarmed bandit problem with multiple plays-Part I: I.I.D. rewardsIEEE Transactions on Automatic Control, 1987
- Asymptotically efficient adaptive allocation rulesAdvances in Applied Mathematics, 1985