Adaptive Social Learning for Slow Markov Chains
- 8 September 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 73 (1053587X) , 3671-3687
Abstract
This paper studies the problem of interconnected agents collaborating to track a dynamic state from partially informative observations, where the state follows a slow finite-state Markov chain. While the centralized version of this problem is well understood, the decentralized setting warrants further exploration. This work aims to demonstrate that a decentralized social learning strategy can achieve the same error probability scaling law in the rare transitions regime as the optimal centralized solution. To study this problem, we focus on adaptive social learning (ASL), a recent strategy developed for non-stationary environments, and analyze its performance when the agents’ observations are governed by a hidden, slow Markov chain. Our study yields two key findings. First, we demonstrate that the ASL adaptation performance is closely linked to the dynamics of the underlying Markov chain, achieving a vanishing steady-state error probability when the average drift time of the Markov chain exceeds the ASL adaptation time. Second, we derive a closed-form upper bound for the ASL steady-state error probability in the rare transition regime, showing that it decays similarly to the optimal centralized solution. Simulations illustrate our theoretical findings and provide a comparative analysis with existing strategies.Keywords
Funding Information
- European Union under the Italian National Recovery and Resilience Plan (NRRP) of NextGenerationEU, partnership on Telecommunications of the Future (PE00000001)
This publication has 50 references indexed in Scilit:
- Asynchronous Adaptive Networks a2018
- Cognitive fault diagnosis in Tennessee Eastman Process using learning in the model spaceComputers & Chemical Engineering, 2014
- Modelling species abundance in a river by Negative Binomial hidden Markov modelsComputational Statistics & Data Analysis, 2014
- Social Learning in a Changing World2011
- Opinion Dynamics and Learning in Social NetworksDynamic Games and Applications, 2010
- Applications of continuous time hidden Markov models to the study of misclassified disease outcomesStatistics in Medicine, 2003
- Elements of Information Theory2001
- Continuous-Time Markov Chains and Applications1998
- Asymptotic filtering for finite state Markov chainsStochastic Processes and their Applications, 1996
- A plant-wide industrial process control problemComputers & Chemical Engineering, 1993