Model-Free Adaptive Control for Unknown Nonlinear Zero-Sum Differential Game
- 17 July 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 48 (5) , 1633-1646
Abstract
In this paper, we present a new model-free globalized dual heuristic dynamic programming (GDHP) approach for the discrete-time nonlinear zero-sum game problems. First, the online learning algorithm is proposed based on the GDHP method to solve the Hamilton-Jacobi-Isaacs equation associated with H ∞ optimal regulation control problem. By setting backward one step of the definition of performance index, the requirement of system dynamics, or an identifier is relaxed in the proposed method. Then, three neural networks are established to approximate the optimal saddle point feedback control law, the disturbance law, and the performance index, respectively. The explicit updating rules for these three neural networks are provided based on the data generated during the online learning along the system trajectories. The stability analysis in terms of the neural network approximation errors is discussed based on the Lyapunov approach. Finally, two simulation examples are provided to show the effectiveness of the proposed method.Keywords
Funding Information
- National Science Foundation (ECCS 1053717, CMMI 1526835)
- National Natural Science Foundation of China (51529701)
- Beijing Natural Science Foundation (4162065)
This publication has 51 references indexed in Scilit:
- ${\rm H}_{\infty}$ State Estimation for Discrete-Time Chaotic Systems Based on a Unified ModelIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2012
- A three-network architecture for on-line learning and optimization based on adaptive dynamic programmingNeurocomputing, 2012
- An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential gamesAutomatica, 2011
- $H_\infty$-Filter Design for a Class of Networked Control Systems Via T–S Fuzzy-Model ApproachIEEE Transactions on Fuzzy Systems, 2009
- Stability Analysis and $H_{\infty}$ Controller Design of Discrete-Time Fuzzy Large-Scale Systems Based on Piecewise Lyapunov FunctionsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2008
- Online learning control by association and reinforcementIEEE Transactions on Neural Networks, 2001
- An algorithm to solve the discrete HJI equation arising in the L2 gain optimization problemInternational Journal of Control, 1999
- Numerical approach to computing nonlinear H-infinity control lawsJournal of Guidance, Control, and Dynamics, 1995
- H/sub /spl infin control via measurement feedback for general nonlinear systemsIEEE Transactions on Automatic Control, 1995
- L/sub 2/-gain analysis of nonlinear systems and nonlinear state-feedback H/sub infinity / controlIEEE Transactions on Automatic Control, 1992