Autonomous maneuver strategy of swarm air combat based on DDPG
Open Access
- 4 December 2021
- journal article
- research article
- Published by Springer Nature in Autonomous Intelligent Systems
- Vol. 1 (1) , 1-12
Abstract
Unmanned aerial vehicles (UAVs) have been found significantly important in the air combats, where intelligent and swarms of UAVs will be able to tackle with the tasks of high complexity and dynamics. The key to empower the UAVs with such capability is the autonomous maneuver decision making. In this paper, an autonomous maneuver strategy of UAV swarms in beyond visual range air combat based on reinforcement learning is proposed. First, based on the process of air combat and the constraints of the swarm, the motion model of UAV and the multi-to-one air combat model are established. Second, a two-stage maneuver strategy based on air combat principles is designed which include inter-vehicle collaboration and target-vehicle confrontation. Then, a swarm air combat algorithm based on deep deterministic policy gradient strategy (DDPG) is proposed for online strategy training. Finally, the effectiveness of the proposed algorithm is validated by multi-scene simulations. The results show that the algorithm is suitable for UAV swarms of different scales.Keywords
Funding Information
- Foundation of CETC Key Laboratory of Data Link Technology (CLDL-20202101)
- National Natural Science Foundation of China (61803309)
- the Key Research and Development Project of Shaanxi Province (2020ZDLGY06-02)
- the Aeronautical Science Foundation of China (2019ZA053008)
- the China Postdoctoral Science Foundation (2018M633574)
This publication has 26 references indexed in Scilit:
- Modeling and simulation of dynamic ant colony’s labor division for task allocation of UAV swarmPhysica A: Statistical Mechanics and its Applications, 2018
- Aerial vehicle guidance based on passive machine learning techniqueInternational Journal of Intelligent Computing and Cybernetics, 2016
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- A stochastic game-theoretic approach for analysis of multiple cooperative air combat2015
- Research on maneuvering decisions for multi-UAVs Air combat2014
- Multi-drug resistant A cinetobacterinfections in critically injured Canadian forces soldiersBMC Infectious Diseases, 2007
- Artificial immune system approach for air combat maneuvering2007
- Modeling Pilot's Sequential Maneuvering Decisions by a Multistage Influence DiagramJournal of Guidance, Control, and Dynamics, 2004
- On Applied Nonlinear and Bilevel Programming or Pursuit-Evasion GamesJournal of Optimization Theory and Applications, 2001
- Game theory for automated maneuvering during air-to-air combatJournal of Guidance, Control, and Dynamics, 1990