Distributed Model-Free Optimal Control for Multiagent Pursuit-Evasion Differential Games
- 12 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 11 (4) , 3800-3811
Abstract
This paper designs optimal control polices for networked multiagent pursuit-evasion game (MPEG) problems based on reinforcement learning (RL) technique. Depending on the number of evaders, MPEG is formulated into several simpler multiple-pursuer single-evader games (MPSEGs) by a divide and conquer approach. Then we propose optimal control policies for all the agents in each MPSEG, which constitute a distributed Nash equilibrium, and provide the capturability and Nash equilibrium analysis. Finally, a data-driven RL algorithm is developed to online learn optimal control polices using measurable behavior data. A simulation example is given to verify the effectiveness of the proposed approach.Keywords
Funding Information
- National Key R&D Program of China (2018YFA0702200)
- National Natural Science Foundation of China (62203208, 62373196, 52077106)
- Natural Science Research Project of Jiangsu Higher Education Institutions (20KJB120002)
This publication has 34 references indexed in Scilit:
- Decentralized optimal large scale multi-player pursuit-evasion strategies: A mean field game approach with reinforcement learningNeurocomputing, 2022
- Optimal game theoretic solution of the pursuit‐evasion intercept problem using on‐policy reinforcement learningInternational Journal of Robust and Nonlinear Control, 2021
- Stability and robustness analysis of minmax solutions for differential graphical gamesAutomatica, 2020
- Optimal Evading Strategies and Task Allocation in Multi-player Pursuit–Evasion ProblemsDynamic Games and Applications, 2019
- A Geometric Approach for the Cooperative Two-Pursuer One-Evader Differential GameIFAC-PapersOnLine, 2017
- Zero-Sum Pursuit-Evasion Differential Games with Many Objects: Survey of PublicationsDynamic Games and Applications, 2016
- Multi-player pursuit–evasion games with one superior evaderAutomatica, 2016
- Evasion from many pursuers in simple motion differential game with integral constraintsEuropean Journal of Operational Research, 2012
- Distributed Hybrid Control for Multiple-Pursuer Multiple-Evader Games2007
- The connection function–theory and applicationInternational Journal of Circuit Theory and Applications, 1975