A Deep Reinforcement Learning-Based Cooperative Guidance Strategy Under Uncontrollable Velocity Conditions
Open Access
Abstract
We present a novel approach to generating a cooperative guidance strategy using deep reinforcement learning to address the challenge of cooperative multi-missile strikes under uncontrollable velocity conditions. This method employs the multi-agent proximal policy optimization (MAPPO) algorithm to construct a continuous action space framework for intelligent cooperative guidance. A heuristically reshaped reward function is designed to enhance cooperative guidance among agents, enabling effective target engagement while mitigating the low learning efficiency caused by sparse reward signals in the guidance environment. Additionally, a multi-stage curriculum learning approach is introduced to smooth agent actions, effectively reducing action oscillations arising from independent sampling in reinforcement learning. Simulation results demonstrate that the proposed deep reinforcement learning-based guidance law can successfully achieve cooperative attacks across a range of randomized initial conditions.Keywords
Funding Information
- Chinese Aeronautical Establishment (202400010530002, 20230001053004)
This publication has 38 references indexed in Scilit:
- Reinforcement learning algorithms: A brief surveyExpert Systems with Applications, 2023
- Improving multi-target cooperative tracking guidance for UAV swarms using multi-agent reinforcement learningChinese Journal of Aeronautics, 2022
- Polynomial based Impact Time and Impact Angle Constrained GuidanceIFAC-PapersOnLine, 2022
- Guidance algorithm for impact time, angle, and acceleration control under varying velocity conditionAerospace Science and Technology, 2022
- Impact time and angle constrained guidance via range‐based line‐of‐sight shapingInternational Journal of Robust and Nonlinear Control, 2022
- Virtual target approach-based optimal guidance law with both impact time and terminal angle constraintsNonlinear Dynamics, 2022
- Missile guidance with assisted deep reinforcement learning for head-on interception of maneuvering targetComplex & Intelligent Systems, 2021
- Multiple missiles cooperative guidance with simultaneous attack requirement under directed topologiesAerospace Science and Technology, 2019
- Two-stage guidance law with impact time and angle constraintsNonlinear Dynamics, 2018
- Guidance law with impact time and impact angle constraintsChinese Journal of Aeronautics, 2013