Integral Reinforcement Learning-Based Online Adaptive Dynamic Event-Triggered Control Design in Mixed Zero-Sum Games for Unknown Nonlinear Systems
Open Access
- 12 December 2024
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 12 (24) , 3916
Abstract
Mixed zero-sum games consider both zero-sum and non-zero-sum differential game problems simultaneously. In this paper, multiplayer mixed zero-sum games (MZSGs) are studied by the means of an integral reinforcement learning (IRL) algorithm under the dynamic event-triggered control (DETC) mechanism for completely unknown nonlinear systems. Firstly, the adaptive dynamic programming (ADP)-based on-policy approach is proposed for solving the MZSG problem for the nonlinear system with multiple players. Secondly, to avoid using dynamic information of the system, a model-free control strategy is developed by utilizing actor–critic neural networks (NNs) for addressing the MZSG problem of unknown systems. On this basis, for the purpose of avoiding wasted communication and computing resources, the dynamic event-triggered mechanism is integrated into the integral reinforcement learning algorithm, in which a dynamic triggering condition is designed to further reduce triggering times. With the help of the Lyapunov stability theorem, the system states and weight values of NNs are proven to be uniformly ultimately bounded (UUB) stable. Finally, two examples are demonstrated to show the effectiveness and feasibility of the developed control method. Compared with static event-triggering mode, the simulation results show that the number of actuator updates in the DETC mechanism has been reduced by 55% and 69%, respectively.Keywords
Funding Information
- National Key R&D Program Project (2022YFF0610400, 2022JH2/101300246, 2023-MSLH-260, JYTQN2023287)
- Liaoning Province Applied Basic Research Program Project (2022YFF0610400, 2022JH2/101300246, 2023-MSLH-260, JYTQN2023287)
- Liaoning Provincial Science and Technology Plan Project (2022YFF0610400, 2022JH2/101300246, 2023-MSLH-260, JYTQN2023287)
- Liaoning Provincial Department of Education Youth Program for Higher Education Institutions (2022YFF0610400, 2022JH2/101300246, 2023-MSLH-260, JYTQN2023287)
- Project of Shenyang Key Laboratory for Innovative Application of Industrial Intelligent Chips and Network Systems (2022YFF0610400, 2022JH2/101300246, 2023-MSLH-260, JYTQN2023287)
This publication has 39 references indexed in Scilit:
- Dynamic event-triggered non-fragile dissipative filtering for interval type-2 fuzzy Markov jump systemsInternational Journal of Machine Learning and Cybernetics, 2024
- A novel actor–critic–identifier architecture for nonlinear multiagent systems with gradient descent methodAutomatica, 2023
- Event‐triggered adaptive fuzzy optimal control of modular robot manipulators using zero‐sum differential game through value iterationInternational Journal of Adaptive Control and Signal Processing, 2023
- Adaptive optimal safety tracking control for multiplayer mixed zero-sum games of continuous-time systemsApplied Intelligence, 2023
- Event‐triggered pinning synchronization and robust pinning synchronization of coupled neural networks with multiple weightsInternational Journal of Adaptive Control and Signal Processing, 2022
- Modified action decoder using Bayesian reasoning for multi-agent deep reinforcement learningInternational Journal of Machine Learning and Cybernetics, 2021
- Adaptive dynamic programming for tracking design of uncertain nonlinear systems with disturbances and input constraintsInternational Journal of Adaptive Control and Signal Processing, 2017
- Sampling-based event-triggered consensus for multi-agent systemsNeurocomputing, 2016
- Reinforcement learning and neural networks for multi-agent nonzero-sum games of nonlinear constrained-input systemsInternational Journal of Machine Learning and Cybernetics, 2014
- Adaptive optimal control for continuous-time linear systems based on policy iterationAutomatica, 2009