Intercept Guidance of Maneuvering Targets with Deep Reinforcement Learning
Open Access
- 13 September 2023
- journal article
- research article
- Published by Wiley in International Journal of Aerospace Engineering
- Vol. 2023, 1-16
Abstract
In this paper, a novel guidance law based on a reinforcement learning (RL) algorithm is presented to deal with the maneuvering target interception problem using a deep deterministic policy gradient descent neural network. We take the missile’s line-of-sight (LOS) rate as the observation of the RL algorithm and propose a novel reward function, which is constructed with the miss distance and LOS rate to train the neural network off-line. In the guidance process, the trained neural network has the capacity of mapping the missile’s LOS rate to the normal acceleration of the missile directly, so as to generate guidance commands in real time. Under the actor-critic (AC) framework, we adopt the twin-delayed deep deterministic policy gradient (TD3) algorithm by taking the minimum value between a pair of critics to reduce overestimation. Simulation results show that the proposed TD3-based RL guidance law outperforms the current state of the RL guidance law, has better performance to cope with continuous action and state space, and also has a faster convergence speed and higher reward. Furthermore, the proposed RL guidance law has better accuracy and robustness when intercepting a maneuvering target, and the LOS rate is converged.Keywords
Funding Information
- National Natural Science Foundation of China (1147213611402117)
This publication has 29 references indexed in Scilit:
- Adaptive reaching law based three-dimensional finite-time guidance law against maneuvering targets with input saturationAerospace Science and Technology, 2017
- Aerial vehicle guidance based on passive machine learning techniqueInternational Journal of Intelligent Computing and Cybernetics, 2016
- Finite-time guidance laws for three-dimensional missile-target interceptionProceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Missile Guidance Law Based on Robust Model Predictive Control Using Neural-Network OptimizationIEEE Transactions on Neural Networks and Learning Systems, 2014
- Artificial Intelligence learning based on proportional navigation guidance2013
- A real-time dynamic optimal guidance scheme using a general regression neural networkEngineering Applications of Artificial Intelligence, 2013
- Research on Fuzzy Guidance Law for Unmanned Aerial Vehicle2013
- Sliding-Mode Guidance and Control for All-Aspect Interceptors with Terminal Angle ConstraintsJournal of Guidance, Control, and Dynamics, 2012
- Design of Missile Guidance Law via Variable Structure ControlJournal of Guidance, Control, and Dynamics, 2001