Cooperative Jamming Resource Allocation with Joint Multi-Domain Information Using Evolutionary Reinforcement Learning
Open Access
- 29 May 2024
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 16 (11) , 1955
Abstract
Addressing the formidable challenges posed by multiple jammers jamming multiple radars, which arise from spatial discretization, many degrees of freedom, numerous model input parameters, and the complexity of constraints, along with a multi-peaked objective function, this paper proposes a cooperative jamming resource allocation method, based on evolutionary reinforcement learning, that uses joint multi-domain information. Firstly, an adversarial scenario model is established, characterizing the interaction between multiple jammers and radars based on a multi-beam jammer model and a radar detection model. Subsequently, considering real-world scenarios, this paper analyzes the constraints and objective function involved in cooperative jamming resource allocation by multiple jammers. Finally, accounting for the impact of spatial, frequency, and energy domain information on jamming resource allocation, matrices representing spatial condition constraints, jamming beam allocation, and jamming power allocation are formulated to characterize the cooperative jamming resource allocation problem. Based on this foundation, the joint allocation of the jamming beam and jamming power is optimized under the constraints of jamming resources. Through simulation experiments, it was determined that, compared to the dung beetle optimizer (DBO) algorithm and the particle swarm optimization (PSO) algorithm, the proposed evolutionary reinforcement learning algorithm based on DBO and Q-Learning (DBO-QL) offers 3.03% and 6.25% improvements in terms of jamming benefit and 26.33% and 50.26% improvements in terms of optimization success rate, respectively. In terms of algorithm response time, the proposed hybrid DBO-QL algorithm has a response time of 0.11 s, which is 97.35% and 96.57% lower than the response times of the DBO and PSO algorithms, respectively. The results show that the method proposed in this paper has good convergence, stability, and timeliness.Keywords
Funding Information
- Shanghai Aerospace Science and Technology Innovation Foundation (SAST2022-063)
This publication has 33 references indexed in Scilit:
- Adaptive allocation strategy for cooperatively jamming netted radar system based on improved cuckoo search algorithmDefence Technology, 2023
- Dung beetle optimizer: a new meta-heuristic algorithm for global optimizationThe Journal of Supercomputing, 2022
- A deep reinforcement learning based hybrid algorithm for efficient resource scheduling in edge computing environmentInformation Sciences, 2022
- A cooperative interference resource allocation method based on improved firefly algorithmDefence Technology, 2021
- Joint resource allocation and power control for radar interference mitigation in multi-UAV networksScience China Information Sciences, 2021
- Multi-agent deep reinforcement learning: a surveyArtificial Intelligence Review, 2021
- Recruitment-imitation mechanism for evolutionary reinforcement learningInformation Sciences, 2021
- Combined use of coral reefs optimization and reinforcement learning for improving resource utilization and load balancing in cloud environmentsComputing, 2021
- A Novel Cognitive Jamming Architecture for Heterogeneous Cognitive Electronic Warfare Networks2019
- Human-level control through deep reinforcement learningNature, 2015