Distributed Optimal Consensus Control for Nonlinear Multi-agent System with Unknown Dynamic
Authors:
- Jilie ZhangJZJilie Zhang
- Huaguang ZhangHZHuaguang Zhang
- Tao FengTFTao Feng
Preprint
Abstract
This paper focuses on the distributed optimal cooperative control for continuous-time nonlinear multi-agent systems (MASs) with completely unknown dynamics via adaptive dynamic programming (ADP) technology. By introducing predesigned extra compensators, the augmented neighborhood error systems are derived which successfully circumvents the system knowledge requirement for ADP. It is revealed that the optimal consensus protocols actually work as solutions of the MAS differential game. Policy iteration (PI) algorithm is adopted, and it is theoretically proved that the iterative value function sequence strictly converges to the solution of the coupled Hamilton-Jacobi-Bellman (CHJB) equation. Based on this point, a novel online iterative scheme is proposed which runs based on the data sampled from the augmented system and the gradient of the value function. Neural networks (NNs) are employed to implement the algorithm and the weights are updated, in the least-square sense, to the ideal value which yields approximated optimal consensus protocols. Finally, a numerical example is given to illustrate the effectiveness of the proposed scheme.Keywords
All Related Versions
This publication has 38 references indexed in Scilit:
- Observer‐based adaptive control for stochastic nonstrict‐feedback systems with unknown backlash‐like hysteresisInternational Journal of Adaptive Control and Signal Processing, 2017
- Stability of switched nonlinear systems with delay and disturbanceAutomatica, 2016
- Observer-based adaptive sliding mode control for nonlinear Markovian jump systemsAutomatica, 2016
- LQR‐based optimal topology of leader‐following consensusInternational Journal of Robust and Nonlinear Control, 2014
- Multi-agent differential graphical games: Online adaptive learning solution for synchronization with optimalityAutomatica, 2012
- Multi-player non-zero-sum games: Online adaptive learning solution of coupled Hamilton–Jacobi equationsAutomatica, 2011
- An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential gamesAutomatica, 2011
- Adaptive optimal control for continuous-time linear systems based on policy iterationAutomatica, 2009
- Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approachAutomatica, 2005
- Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networksNeural Networks, 1990