An Intelligent Anti-Jamming Scheme for Cognitive Radio Based on Deep Reinforcement Learning
Authors:
Open Access
- 5 November 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 202563-202572
Abstract
Cognitive radio network is an intelligent wireless communication system which can adjust its transmission parameters according to the environment thanks to its learning ability. It is a feasible and promising direction to solve the spectrum scarcity issue and has become a research focus in communication community. However, cognitive radio network is vulnerable to jamming attack, resulting in serious degradation of spectrum utilization. In this paper, we view the anti-jamming task of cognitive radio as a Markov decision process and propose an intelligent anti-jamming scheme based on deep reinforcement learning. We aim to learn a policy for users to maximize their rate of successful transmission. Specifically, we design Double Deep Q Network (Double DQN) to model the confrontation between the cognitive radio network and the jammer. The Q network is implemented using Transformer encoder to effectively estimate action-values from raw spectrum data. The simulation results indicate that our approach can effectively defend against several kinds of jamming attacks.Keywords
Funding Information
- Natural Science Foundation of Zhejiang Province (LQ18F020007)
This publication has 25 references indexed in Scilit:
- Stackelberg Equilibria of an Anti-Jamming Game in Cooperative Cognitive Radio NetworksIEEE Transactions on Cognitive Communications and Networking, 2017
- A Hierarchical Learning Solution for Anti-Jamming Stackelberg Game With Discrete Power StrategiesIEEE Wireless Communications Letters, 2017
- Deep Residual Learning for Image Recognition2016
- Jamming Bandits—A Novel Learning Method for Optimal JammingIEEE Transactions on Wireless Communications, 2015
- Deep learningNature, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Competing Mobile Network Game: Embracing antijamming and jamming strategies with reinforcement learning2013
- A Survey on Security Threats and Detection Techniques in Cognitive Radio NetworksIEEE Communications Surveys & Tutorials, 2012
- Anti-Jamming Games in Multi-Channel Cognitive Radio NetworksIEEE Journal on Selected Areas in Communications, 2011
- Cognitive radio: brain-empowered wireless communicationsIEEE Journal on Selected Areas in Communications, 2005