Stability of Piecewise-Deterministic Markov Processes
Authors:
- François DufourFDFrançois Dufour
- Oswaldo L. V. CostaOCOswaldo L. V. Costa
- 1 January 1999
- journal article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Control and Optimization
- Vol. 37 (5) , 1483-1502
Abstract
In this paper, we study a form of stability for a general family of nondiffusion Markov processes known in the literature as piecewise-deterministic Markov process (PDMP). By stability here we mean the existence of an invariant probability measure for the PDMP. It is shown that the existence of such an invariant probability measure is equivalent to the existence of a $\sigma$-finite invariant measure for a Markov kernel G linked to the resolvent operator U of the PDMP, satisfying a boundedness condition or, equivalently, a Radon--Nikodým derivative. Here we generalize existing results of the literature [O. Costa, J. Appl. Prob., 27, (1990), pp. 60--73; M. Davis, Markov Models and Optimization, Chapman and Hall, 1993] since we do not require any additional assumptions to establish this equivalence. Moreover, we give sufficient conditions to ensure the existence of such a $\sigma$-finite measure satisfying the boundedness condition. They are mainly based on a modified Foster--Lyapunov criterion for the case in which the Markov chain generated by G is either recurrent or weak Feller. To emphasize the relevance of our results, we study three examples and in particular, we are able to generalize the results obtained by Costa and Davis on the capacity expansion model.Keywords
This publication has 14 references indexed in Scilit:
- Existence and Uniqueness of Fixed Points for Markov Operators and Markov ProcessesProceedings of the London Mathematical Society, 1998
- Invariant probabilities for Markov chains on a metric spaceStatistics & Probability Letters, 1997
- Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processesAdvances in Applied Probability, 1993
- Markov Chains and Stochastic Stability1993
- Asymptotic Behavior of Stochastic Systems Possessing Markovian RealizationsSIAM Journal on Control and Optimization, 1991
- Stationary distributions for piecewise-deterministic Markov processesJournal of Applied Probability, 1990
- Ergodic Theorems for Discrete Time Stochastic Systems Using a Stochastic Lyapunov FunctionSIAM Journal on Control and Optimization, 1989
- Optimal capacity expansion under uncertaintyAdvances in Applied Probability, 1987
- Conservative markov processes on a topological spaceIsrael Journal of Mathematics, 1970
- Mesure invariante sur les classes récurrentes des processus de MarkovProbability Theory and Related Fields, 1967