Pursuit-Interception Strategy in Differential Games Based on Q-Learning-Cover Algorithm
Open Access
Abstract
Due to the limited difference in maneuverability between the pursuer and the evader in three-dimensional space, it is difficult for a single pursuer to capture the evader. To address this, this paper proposes a strategy where three pursuers intercept one evader and introduces a Q-learning-cover algorithm. Based on the motion models of the pursuers and the evader in three-dimensional space, this paper presents a region coverage scheme based on the Ahlswede ball and analyzes the convergence upper bound of the Q-learning-cover algorithm by designing an appropriate Lyapunov function. Through extensive model training, the successful capture of the evader by the pursuers in a three-on-one scenario was achieved. Finally, numerical simulation experiments and hardware-in-the-loop simulation experiments are presented, both of which demonstrate that the proposed Q-learning-cover algorithm can effectively realize the three-on-one encirclement and interception of the evading target.Keywords
Funding Information
- National Natural Science Foundation of China (61773142)
This publication has 37 references indexed in Scilit:
- Three-dimensional cooperative guidance strategy and guidance law for intercepting highly maneuvering targetChinese Journal of Aeronautics, 2021
- A robust three-dimensional cooperative guidance law against maneuvering targetJournal of the Franklin Institute, 2020
- A modified cooperative proportional navigation guidance lawJournal of the Franklin Institute, 2019
- Coverage-based three-dimensional cooperative guidance strategy against highly maneuvering targetAerospace Science and Technology, 2019
- Cooperative interception strategy for multiple inferior missiles against one highly maneuvering targetAerospace Science and Technology, 2018
- Coverage-based cooperative guidance strategy against highly maneuvering targetAerospace Science and Technology, 2017
- A Geometric Approach for the Cooperative Two-Pursuer One-Evader Differential GameIFAC-PapersOnLine, 2017
- Three-dimensional cooperative guidance laws against stationary and maneuvering targetsChinese Journal of Aeronautics, 2015
- Neural network compensation control for mechanical systems with disturbancesAutomatica, 2009
- A Lyapunov-like approach to performance analysis of 3-dimensional pure PNG lawsIEEE Transactions on Aerospace and Electronic Systems, 1994