Continuous-Time Markov Networks: From Merging Rules to Synchronizing Control
- 17 June 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 70 (12) , 7923-7938
Abstract
This paper characterizes the state space representation and control Lyapunov theory for continuous-time Markov networks (CT-MNs), which constitute a family of Markov chains endowed with network structures, serving as the theoretical basis for the investigations of several swarm behaviors. First, the notions of coupling Markov property and conditional independent property are introduced, enabling a CT-MN to be merged as a decentralized continuous-time Markov chain (CT-MC). Then, explicit formulas for the transition rate matrix of the augmented CT-MCs are derived. Consequently, key problems in CT-MNs can be reformulated as set-stability or set-stabilization problems for the augmented CT-MCs, with feedback controllers designed via linear programming subject to Lyapunov-based stability constraints. Furthermore, master slave synchronization and output regulation of CT-MNs are addressed. Finally, numerical examples validate the theoretical results and demonstrate their effectiveness in practical applications.Keywords
Funding Information
- National Natural Science Foundation of China (62103232, 62373308, 62273286)
- Natural Science Foundation of Shandong Province (ZR2021QF005)
- Qilu Young Scholars Project of Shandong University
- Scholar Project of Shandong Province (tsqn202312033)
- Central Leading Local Science and Technology Development Fund (2023ZYD0009)
- General Research Fund (17200124)
- Guangdong Basic Research and Applied Research Fund
- Research Grants Council of Hong Kong (STG1/E-401/23-N, C4026-21G, 17209021)
- Center for Transformative Garment Production and the Multi-scale Medical Robotics Center
- InnoHK Initiative of the Innovation and Technology Commission of the HKSAR Government
- Fundamental Research Funds for the Central Universities
This publication has 31 references indexed in Scilit:
- Asymptotical stability of continuous-time probabilistic logic networks based on transition rateScience China Information Sciences, 2023
- Set stability and set stabilization of Boolean control networks based on invariant subsetsAutomatica, 2015
- Output tracking control of Boolean control networks via state feedback: Constant reference signal caseAutomatica, 2015
- State feedback stabilization for probabilistic Boolean networksAutomatica, 2014
- On the robust synthesis of logical consensus algorithms for distributed intrusion detectionAutomatica, 2013
- On controllability and stabilizability of probabilistic Boolean control networksScience China Information Sciences, 2013
- Analysis and Control of Boolean Networks2011
- Reinforcement learning with replacing eligibility tracesMachine Learning, 1996
- Continuous-Time Markov Chains1991
- Metabolic stability and epigenesis in randomly constructed genetic netsJournal of Theoretical Biology, 1969