Data-Based Optimal Control of Multiagent Systems: A Reinforcement Learning Design Approach
Authors:
- 26 September 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 49 (12) , 4441-4449
Abstract
This paper studies an optimal consensus tracking problem of heterogeneous linear multiagent systems. By introducing tracking error dynamics, the optimal tracking problem is reformulated as finding a Nash-equilibrium solution to multiplayer games, which can be done by solving associated coupled Hamilton–Jacobi equations. A data-based error estimator is designed to obtain the data-based control for the multiagent systems. Using the quadratic functional to approximate every agent’s value function, we can obtain the optimal cooperative control by the input–output (I/O) ${Q}$ -learning algorithm with a value iteration technique in the least-square sense. The control law solves the optimal consensus problem for multiagent systems with measured I/O information, and does not rely on the model of multiagent systems. A numerical example is provided to illustrate the effectiveness of the proposed algorithm.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (61603314, 61773322, 61627809, 61473070, 61433004)
This publication has 24 references indexed in Scilit:
- Overview: Collective Control of Multiagent SystemsIEEE Transactions on Control of Network Systems, 2015
- Error Bounds of Adaptive Dynamic Programming Algorithms for Solving Undiscounted Optimal Control ProblemsIEEE Transactions on Neural Networks and Learning Systems, 2015
- A survey of multi-agent formation controlAutomatica, 2015
- Leader-Based Optimal Coordination Control for the Consensus Problem of Multiagent Differential Games via Fuzzy Adaptive Dynamic ProgrammingIEEE Transactions on Fuzzy Systems, 2014
- Synchronization of discrete-time multi-agent systems on graphs using Riccati designAutomatica, 2013
- Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamicsAutomatica, 2012
- Multi-agent differential graphical games: Online adaptive learning solution for synchronization with optimalityAutomatica, 2012
- Adaptive cooperative tracking control of higher-order nonlinear systems with unknown dynamicsAutomatica, 2012
- Multi-player non-zero-sum games: Online adaptive learning solution of coupled Hamilton–Jacobi equationsAutomatica, 2011
- Adaptive dynamic programmingIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2002