RL-Based Frequency Hopping With Block-Shifted Patterns: Balancing Between Anti-Jamming Performance and Synchronization Overhead
- 22 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 73 (1) , 909-922
Abstract
Wireless transmissions are inherently vulnerable to jamming attacks. Frequency hopping (FH) has been widely employed in practice to combat jamming attacks. Although the recent use of reinforcement learning (RL) could improve the anti-jamming performance, a dynamic selection of working frequency in RL-based FH schemes makes them less attractive due to significant overhead for achieving the frequency synchronization between legitimate transmitter and receiver. In order to get a balance between anti-jamming performance and synchronization overhead, this paper proposes a novel RL-based FH approach with block-shifted patterns, where the FH pattern between legitimate transmitter and receiver slowly changes in a block- wise manner and the pattern under a block window is shifted with an offset determined by an RL algorithm. In this way, the synchronization overhead could be well alleviated. Then, we derive some theoretical results for the effect of block size on the anti-jamming performance. Extensive experiments show that the proposed algorithm can reach the analytic bound on throughput of the proposed FH scheme. By properly selecting a block size, the proposed FH scheme could achieve the target balance between anti-jamming performance and synchronization overhead.Keywords
This publication has 31 references indexed in Scilit:
- “Advancing Secretly by an Unknown Path”: A Reinforcement Learning-Based Hidden Strategy for Combating Intelligent Reactive JammerIEEE Wireless Communications Letters, 2022
- Enhanced Index Modulation-Based Frequency Hopping: Resist Power-Correlated Reactive JammerIEEE Wireless Communications Letters, 2022
- Better Late Than Never: GAN-Enhanced Dynamic Anti-Jamming Spectrum Access With Incomplete Sensing InformationIEEE Wireless Communications Letters, 2021
- Dynamic Spectrum Anti-Jamming in Broadband Communications: A Hierarchical Deep Reinforcement Learning ApproachIEEE Wireless Communications Letters, 2020
- A Collaborative Multi-Agent Reinforcement Learning Anti-Jamming Algorithm in Wireless NetworksIEEE Wireless Communications Letters, 2019
- Anti-Jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning ApproachIEEE Communications Letters, 2018
- You Can Jam But You Cannot Hide: Defending Against Jamming Attacks for Geo-Location Database Driven Spectrum SharingIEEE Journal on Selected Areas in Communications, 2016
- Human-level control through deep reinforcement learningNature, 2015
- Towards Optimal Adaptive UFH-Based Anti-Jamming Wireless CommunicationIEEE Journal on Selected Areas in Communications, 2011
- Anti-jamming broadcast communication using uncoordinated spread spectrum techniquesIEEE Journal on Selected Areas in Communications, 2010