Reinforcement learning-based radar-evasive path planning: a comparative analysis
- 26 October 2021
- journal article
- research article
- Published by Cambridge University Press (CUP) in The Aeronautical Journal
- Vol. 126 (1297) , 547-564
Abstract
This paper discusses the utilisation of deep reinforcement learning algorithms to obtain optimal paths for an aircraft to avoid or minimise radar detection and tracking. A modular approach is adopted to formulate the problem, including the aircraft kinematics model, aircraft radar cross-section model and radar tracking model. A virtual environment is designed for single and multiple radar cases to obtain optimal paths. The optimal trajectories are generated through deep reinforcement learning in this study. Specifically, three algorithms, namely deep deterministic policy gradient, trust region policy optimisation and proximal policy optimisation, are used to find optimal paths for five test cases. The comparison is carried out based on six performance indicators. The investigation proves the importance of these reinforcement learning algorithms in optimal path planning. The results indicate that the proximal policy optimisation approach performed better for optimal paths in general.Keywords
This publication has 28 references indexed in Scilit:
- Control of a Quadrotor With Reinforcement LearningIEEE Robotics and Automation Letters, 2017
- A fast stealth trajectory planning algorithm for stealth UAV to fly in multi-radar network2016
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- Optimization of transition maneuvers through aerodynamic vectoringAerospace Science and Technology, 2012
- Optimal Path Planning for Unmanned Combat Aerial Vehicles to Defeat Radar TrackingJournal of Guidance, Control, and Dynamics, 2006
- Radar cross-section reduction via route planning and intelligent controlIEEE Transactions on Control Systems Technology, 2002
- Aircraft trajectories considering radar range constraintsAerospace Science and Technology, 2002
- Spline based path planning for unmanned air vehicles2001
- Survey of Numerical Methods for Trajectory OptimizationJournal of Guidance, Control, and Dynamics, 1998
- Aircraft trajectory optimization using nonlinear programming1996