Dynamic Spectrum Anti-Jamming in Broadband Communications: A Hierarchical Deep Reinforcement Learning Approach
- 1 June 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Wireless Communications Letters
- Vol. 9 (10) , 1616-1619
Abstract
In this letter, the frequency selection problem in jamming environment with large number of optional frequencies is investigated. With numerous optional actions in the wider frequency band scenario, most of existing anti-jamming methods will become ineffective, since the convergence time and computational complexity will grow exponentially with the number of actions. To cope with the above challenge, a novel hierarchical deep reinforcement learning algorithm which does not need to know the jamming patterns and channel model is proposed. The proposed algorithm divides the frequency selection problem in the broadband into two steps via two subnetworks: Firstly, the frequency band is selected by the band selection network, and then the specific frequency is selected in this frequency band by the frequency selection network. Simulation results show that the proposed algorithm avoids multiple different jammings effectively and achieves satisfactory throughput with less calculation.Keywords
Funding Information
- National Natural Science Foundation of China (61961010, 61671473, 61771488, 61631020)
- Guangxi Key Laboratory Fund of Embedded Technology and Intelligent System (2018B-1)
- Key Laboratory of Cognitive Radio and Information Processing, Ministry of Education (CRKL180203)
This publication has 7 references indexed in Scilit:
- Dynamic Spectrum Anti-Jamming Communications: Challenges and OpportunitiesIEEE Communications Magazine, 2020
- Reinforcement Learning-Based Control for Unmanned Aerial VehiclesJournal of Communications and Information Networks, 2018
- Cooperative Q-learning based channel selection for cognitive radio networksWireless Networks, 2018
- Anti-Jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning ApproachIEEE Communications Letters, 2018
- Convolutional neural networks at constrained time cost2015
- On the Jamming Power Allocation for Secure Amplify-and-Forward Relaying via Cooperative JammingIEEE Journal on Selected Areas in Communications, 2013
- Stochastic Gradient Descent Tricks2012