Integrated Guidance-and-Control Design for Three-Dimensional Interception Based on Deep-Reinforcement Learning
Open Access
Abstract
This study applies deep-reinforcement-learning algorithms to integrated guidance and control for three-dimensional, high-maneuverability missile-target interception. Dynamic environment, reward functions concerning multi-factors, agents based on the deep-deterministic-policy-gradient algorithm, and action signals with pitch and yaw fins as control commands were constructed in the research, which control the missile in order to intercept targets. Firstly, the missile-interception system includes dynamics such as the inertia of the missile, the aerodynamic parameters, and fin delays. Secondly, to improve the convergence speed and guidance accuracy, a convergence factor for the angular velocity of the target line of sight and deep dual-filter methods were introduced into the design of the reward function. The method proposed in this paper was then compared with traditional proportional navigation. Next, many simulations were carried out on high-maneuverability targets with different initial conditions by randomization. The numerical-simulation results showed that the proposed guidance strategy has higher guidance accuracy and stronger robustness and generalization capability against the aerodynamic parameters.Keywords
This publication has 22 references indexed in Scilit:
- Adaptive integrated guidance and control for impact angle constrained interception with actuator saturationThe Aeronautical Journal, 2019
- Optimal Proportional-Integral Guidance With Reduced Sensitivity to Target ManeuversIEEE Transactions on Aerospace and Electronic Systems, 2018
- Integrated guidance and control for hypersonic vehicles in dive phase with multiple constraintsAerospace Science and Technology, 2016
- Modified Pure Proportional Navigation Guidance Law for Impact Time ControlJournal of Guidance, Control, and Dynamics, 2016
- Human-level control through deep reinforcement learningNature, 2015
- Adaptive pinpoint and fuel efficient mars landing using reinforcement learningIEEE/CAA Journal of Automatica Sinica, 2014
- On Convergence of the Nonlinear Active Disturbance Rejection Control for MIMO SystemsSIAM Journal on Control and Optimization, 2013
- ADRC based input disturbance rejection for minimum-phase plants with unknown orders and/or uncertain relative degreesJournal of Systems Science and Complexity, 2012
- Modern Missile Guidance2007
- Integrated Guidance and Control for Combined Command/Homing Guidance1988