Spectrum Access In Cognitive Radio Using a Two-Stage Reinforcement Learning Approach
- 26 January 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 12 (1) , 20-34
Abstract
With the advent of the 5th generation of wireless standards and an increasing demand for higher throughput, methods to improve the spectral efficiency of wireless systems have become very important. In the context of cognitive radio, a substantial increase in throughput is possible if the secondary user can make smart decisions regarding which channel to sense and when or how often to sense. Here, we propose an algorithm to not only select a channel for data transmission but also to predict how long the channel will remain unoccupied so that the time spent on channel sensing can be minimized. Our algorithm learns in two stages - a reinforcement learning approach for channel selection and a Bayesian approach to determine the optimal duration for which sensing can be skipped. Comparisons with other methods are provided through extensive simulations. We show that the number of sensing operations is minimized with negligible increase in primary user interference; this implies that lesser energy is spent by the secondary user in sensing and also higher throughput is achieved by saving time spent on sensing.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Enhanced Throughput of Cognitive Radio Networks by Imperfect Spectrum PredictionIEEE Communications Letters, 2015
- An Order Optimal Policy for Exploiting Idle Spectrum in Cognitive Radio NetworksIEEE Transactions on Signal Processing, 2015
- Spectrum Usage Models for the Analysis, Design and Simulation of Cognitive Radio Networks2012
- Optimization of Spectrum Sensing for Opportunistic Spectrum Access in Cognitive Radio Networks2007
- Sensing-based opportunistic channel accessMobile Networks and Applications, 2006
- The Nonstochastic Multiarmed Bandit ProblemSIAM Journal on Computing, 2002
- Cognitive radio: making software radios more personalIEEE Wireless Communications, 1999
- Q-learningMachine Learning, 1992
- ON THE LIKELIHOOD THAT ONE UNKNOWN PROBABILITY EXCEEDS ANOTHER IN VIEW OF THE EVIDENCE OF TWO SAMPLESBiometrika, 1933
- On the Likelihood that One Unknown Probability Exceeds Another in View of the Evidence of Two SamplesBiometrika, 1933