Two-dimensional Anti-jamming Mobile Communication Based on Reinforcement Learning
Preprint
Abstract
By using smart radio devices, a jammer can dynamically change its jamming policy based on opposing security mechanisms; it can even induce the mobile device to enter a specific communication mode and then launch the jamming policy accordingly. On the other hand, mobile devices can exploit spread spectrum and user mobility to address both jamming and interference. In this paper, a two-dimensional anti-jamming mobile communication scheme is proposed in which a mobile device leaves a heavily jammed/interfered-with frequency or area. It is shown that, by applying reinforcement learning techniques, a mobile device can achieve an optimal communication policy without the need to know the jamming and interference model and the radio channel model in a dynamic game framework. More specifically, a hotbooting deep Q-network based two-dimensional mobile communication scheme is proposed that exploits experiences in similar scenarios to reduce the exploration time at the beginning of the game, and applies deep convolutional neural network and macro-action techniques to accelerate the learning speed in dynamic situations. Several real-world scenarios are simulated to evaluate the proposed method. These simulation results show that our proposed scheme can improve both the signal-to-interference-plus-noise ratio of the signals and the utility of the mobile devices against cooperative jamming compared with benchmark schemes.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- User-Centric View of Jamming Games in Cognitive Radio NetworksIEEE Transactions on Information Forensics and Security, 2015
- Swift Jamming Attack on Frequency Offset Estimation: The Achilles’ Heel of OFDM SystemsIEEE Transactions on Mobile Computing, 2015
- The challenges facing physical layer securityIEEE Communications Magazine, 2015
- Power control with reinforcement learning in cooperative cognitive radio networks against jammingThe Journal of Supercomputing, 2015
- Modeling, Evaluation and Detection of Jamming Attacks in Time-Critical Wireless ApplicationsIEEE Transactions on Mobile Computing, 2013
- A Survey of Security Challenges in Cognitive Radio Networks: Solutions and Future Research DirectionsProceedings of the IEEE, 2012
- A Survey on Security Threats and Detection Techniques in Cognitive Radio NetworksIEEE Communications Surveys & Tutorials, 2012
- Anti-Jamming Games in Multi-Channel Cognitive Radio NetworksIEEE Journal on Selected Areas in Communications, 2011
- Thwarting Control-Channel Jamming Attacks from Inside JammersIEEE Transactions on Mobile Computing, 2011
- An anti-jamming stochastic game for cognitive radio networksIEEE Journal on Selected Areas in Communications, 2011