Reinforcement Learning Approach for RF-Powered Cognitive Radio Network with Ambient Backscatter
- 1 December 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
For an RF-powered cognitive radio network with ambient backscattering capability, while the primary channel is busy, the RF-powered secondary user (RSU) can either backscatter the primary signal to transmit its own data or harvest energy from the primary signal (and store in its battery). The harvested energy then can be used to transmit data when the primary channel becomes idle. To maximize the throughput for the secondary system, it is critical for the RSU to decide when to backscatter and when to harvest energy. This optimal decision has to account for the dynamics of the primary channel, energy storage capability, and data to be sent. To tackle that problem, we propose a Markov decision process (MDP)-based framework to optimize RSU's decisions based on its current states, e.g., energy, data as well as the primary channel state. As the state information may not be readily available at the RSU, we then design a low-complexity online reinforcement learning algorithm that guides the RSU to find the optimal solution without requiring prior-and complete-information from the environment. The extensive simulation results then clearly show that the proposed solution achieves higher throughputs, i.e., up to 50%, than that of conventional methods.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Hybrid Backscatter Communication for Wireless-Powered Heterogeneous NetworksIEEE Transactions on Wireless Communications, 2017
- Ambient Backscatter: A New Approach to Improve Network Performance for RF-Powered Cognitive Radio NetworksIEEE Transactions on Communications, 2017
- Turbocharging ambient backscatter communicationACM SIGCOMM Computer Communication Review, 2014
- Ambient backscatter2013
- Cognitive Radio Networks with Energy HarvestingIEEE Transactions on Wireless Communications, 2013
- Simulation-based optimization of Markov reward processesIEEE Transactions on Automatic Control, 2001
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998