Reinforcement Learning for Compressed-Sensing Based Frequency Agile Radar in the Presence of Active Interference
Open Access
- 16 February 2022
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 14 (4) , 968
Abstract
Compressed sensing (CS)-based frequency agile radar (FAR) is attractive due to its superior data rate and target measurement performance. However, traditional frequency strategies for CS-based FAR are not cognitive enough to adapt well to the increasingly severe active interference environment. In this paper, we propose a cognitive frequency design method for CS-based FAR using reinforcement learning (RL). Specifically, we formulate the frequency design of CS-based FAR as a model-free partially observable Markov decision process (POMDP) to cope with the non-cooperation of the active interference environment. Then, a recognizer-based belief state computing method is proposed to relieve the storage and computation burdens in solving the model-free POMDP. This method is independent of the environmental knowledge and robust to the sensing scenario. Finally, the double deep Q network-based method using the exploration strategy integrating the CS-based recovery metric into the ϵ-greedy strategy (DDQN-CSR-ϵ-greedy) is proposed to solve the model-free POMDP. This can achieve better target measurement performance while avoiding active interference compared to the existing techniques. A number of examples are presented to demonstrate the effectiveness and advantage of the proposed design.Keywords
Funding Information
- National Natural Science Foundation of China (62001346)
This publication has 23 references indexed in Scilit:
- Multi-Agent Deep Reinforcement Learning Based Spectrum Allocation for D2D Underlay CommunicationsIEEE Transactions on Vehicular Technology, 2019
- Analysis of Frequency Agile Radar via Compressed SensingIEEE Transactions on Signal Processing, 2018
- Optimization theory-based radar waveform design for spectrally dense environmentsIEEE Aerospace and Electronic Systems Magazine, 2017
- Human-level control through deep reinforcement learningNature, 2015
- Cognitive random stepped frequency radar with sparse recoveryIEEE Transactions on Aerospace and Electronic Systems, 2014
- Low Probability of Interception of an Advanced Noise Radar Waveform with Linear-FMIEEE Transactions on Aerospace and Electronic Systems, 2013
- Signal Recovery From Random Measurements Via Orthogonal Matching PursuitIEEE Transactions on Information Theory, 2007
- Cognitive radar: a way of the futureIEEE Signal Processing Magazine, 2006
- A survey of radar ECM and ECCMIEEE Transactions on Aerospace and Electronic Systems, 1995
- Optimal control of Markov processes with incomplete state informationJournal of Mathematical Analysis and Applications, 1965