Abstract
This paper characterizes the state space representation and control Lyapunov theory for continuous-time Markov networks (CT-MNs), which constitute a family of Markov chains endowed with network structures, serving as the theoretical basis for the investigations of several swarm behaviors. First, the notions of coupling Markov property and conditional independent property are introduced, enabling a CT-MN to be merged as a decentralized continuous-time Markov chain (CT-MC). Then, explicit formulas for the transition rate matrix of the augmented CT-MCs are derived. Consequently, key problems in CT-MNs can be reformulated as set-stability or set-stabilization problems for the augmented CT-MCs, with feedback controllers designed via linear programming subject to Lyapunov-based stability constraints. Furthermore, master slave synchronization and output regulation of CT-MNs are addressed. Finally, numerical examples validate the theoretical results and demonstrate their effectiveness in practical applications.
Funding Information
  • National Natural Science Foundation of China (62103232, 62373308, 62273286)
  • Natural Science Foundation of Shandong Province (ZR2021QF005)
  • Qilu Young Scholars Project of Shandong University
  • Scholar Project of Shandong Province (tsqn202312033)
  • Central Leading Local Science and Technology Development Fund (2023ZYD0009)
  • General Research Fund (17200124)
  • Guangdong Basic Research and Applied Research Fund
  • Research Grants Council of Hong Kong (STG1/E-401/23-N, C4026-21G, 17209021)
  • Center for Transformative Garment Production and the Multi-scale Medical Robotics Center
  • InnoHK Initiative of the Innovation and Technology Commission of the HKSAR Government
  • Fundamental Research Funds for the Central Universities

This publication has 31 references indexed in Scilit: