Open Markov Chains: Cumulant Dynamics, Fluctuations and Correlations
Open Access
Abstract
In this work we propose a model for open Markov chains that can be interpreted as a system of non-interacting particles evolving according to the rules of a Markov chain. The number of particles in the system is not constant, because we allow the particles to arrive or leave the state space according to prescribed protocols. We describe this system by looking at the population of particles on every state by establishing the rules of time-evolution of the distribution of particles. We show that it is possible to describe the distribution of particles over the state space through the corresponding moment generating function. This description is given through the dynamics ruling the behavior of such a moment generating function and we prove that the system is able to attain the stationarity under some conditions. We also show that it is possible to describe the dynamics of the two first cumulants of the distribution of particles, which in some way is a simpler technique to obtain useful information of the open Markov chain for practical purposes. Finally we also study the behavior of the time-dependent correlation functions of the number of particles present in the system. We give some simple examples of open chains that either, can be fully described through the moment generating function or partially described through the exact solution of the cumulant dynamics.Keywords
Funding Information
- Secretaría de Ciencia, Humanidades, Tecnología e Innovación (FORDECYT-PRONACES/1327701/2020.)
This publication has 27 references indexed in Scilit:
- A Model for Open Populations Subject to Periodical Re-ClassificationsJournal of Statistical Theory and Practice, 2010
- Stationarity of a stochastic population flow modelJournal of Applied Probability, 1999
- Markov Chain Monte Carlo Simulation Methods in EconometricsEconometric Theory, 1996
- On the limiting behaviour of a non-homogeneous Markovian manpower model with independent Poisson inputJournal of Applied Probability, 1982
- Continuous-time stochastic models of a multigrade populationJournal of Applied Probability, 1978
- A note on the limiting behaviour of discrete-time Markovian manpower models with inhomogeneous independent Poisson inputJournal of Applied Probability, 1977
- A continuous-time population model with poisson recruitmentJournal of Applied Probability, 1976
- Stationary distributions of open Markov processes in discrete time with application to hospital planningJournal of Applied Probability, 1971
- Hierarchical population models with poisson recruitmentJournal of Applied Probability, 1967
- Formulae for Projecting Enrolments and Degrees Awarded in UniversitiesJournal of the Royal Statistical Society. Series A (General), 1963