Asymptotic properties of a singularly perturbed Markov chain with inclusion of transient states
Authors:
- G. BadowskiGBG. Badowski
- G. YinGYG. Yin
- Q. ZhangQZQ. Zhang
Open Access
- 1 May 2000
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Applied Probability
- Vol. 10 (2) , 549-572
Abstract
This work is concerned with aggregations in a singularly perturbed Markov chain having a finite state space and fast and slow motions.The state space of the underlying Markov chain can be decomposed into several groups of recurrent states and a group of transient states.The asymptotic properties are studied through sequences of unscaled and scaled occupation measures.By treating the states within each recurrent class as a single state, an aggregated process is defined and shown to be convergent to a limit Markov chain.In addition, it is shown that a sequence of suitably rescaled occupation measures converges to a switching diffusion process weakly.Keywords
This publication has 17 references indexed in Scilit:
- Continuous-Time Markov Chains and Applications1998
- Structural properties of Markov chains with weak and strong interactionsStochastic Processes and their Applications, 1997
- H∞-Control of Markovian Jump Systems and Solutions to Associated Piecewise-Deterministic Differential Games1995
- Hierarchical Decision Making in Stochastic Manufacturing Systems1994
- Markov Models and Optimization1993
- Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems1990
- Markov Processes1986
- Random Perturbations of Dynamical Systems1984
- Optimal control of markov chains admitting strong and weak interactionsAutomatica, 1981
- Deterministic and Stochastic Optimal Control1975