Optimal consensus control of Markov jump multi-agent systems under switching topology
Authors:
- Bowen LiuBLBowen Liu
- Wei XingWXWei Xing
- Haoyue YangHYHaoyue Yang
- Junfeng ZhangJZJunfeng Zhang
Open Access
- 29 October 2026
- journal article
- Published by OAE Publishing Inc. in Intelligence & Robotics
- Vol. 6 (4) , 868-90
Abstract
This paper investigates the optimal consensus control problem for multi-agent systems with Markov jump characteristics in system parameters and subject to Markov switching in communication topology. Firstly, the cost function is constructed to characterize the impact of topology switching and jumps in system parameters on system performance. Then, to tackle the impact of neighbor coupling terms on the performance of the cost function, the global algebraic Riccati equation is derived to determine the optimal control policy. Within the adaptive dynamic programming framework, global form policy iteration and value iteration algorithm are proposed to solve the global control policy. Subsequently, the convergence of the proposed iterative algorithm is theoretically proved, and the stability of the system is established through the Lyapunov stability theorem. Finally, the effectiveness of the presented optimal control scheme is verified through simulation examples.Keywords
This publication has 38 references indexed in Scilit:
- Homotopic reinforcement learning for distributed consensus control of stochastic Markov jump multi-agent systemsThe Journal of Supercomputing, 2025
- Homotopic policy iteration-based learning design for unknown linear continuous-time systemsAutomatica, 2022
- Optimal consensus model-free control for multi-agent systems subject to input delays and switching topologiesInformation Sciences, 2022
- Reliable asynchronous control for delayed multi-agent systems with stochastic faults and switching topologiesInternational Journal of Systems Science, 2021
- Fuzzy adaptive dynamic programming-based optimal leader-following consensus for heterogeneous nonlinear multi-agent systemsNeural Computing and Applications, 2019
- Data-driven optimal tracking control of discrete-time multi-agent systems with two-stage policy iteration algorithmInformation Sciences, 2019
- An Experimental Study of Time Scales and Stability in Networked Multi-Robot Systems2014
- Optimal Control2012
- Adaptive optimal control for continuous-time linear systems based on policy iterationAutomatica, 2009
- Consensus and Cooperation in Networked Multi-Agent SystemsProceedings of the IEEE, 2007