Stationary distributions for piecewise-deterministic Markov processes
Author:
- O. L. V. CostaOCO. L. V. Costa
- 1 March 1990
- journal article
- Published by Cambridge University Press (CUP) in Journal of Applied Probability
- Vol. 27 (1) , 60-73
Abstract
In this paper we show that the problem of existence and uniqueness of stationary distributions for piecewise-deterministic Markov processes (PDPs) is equivalent to the same problem for the associated Markov chain, so long as some mild conditions on the parameters of the PDP are satisfied. Our main result is the construction of an invertible mapping from the set of stationary distributions for the PDP to the set of stationary distributions for the Markov chain. Some sufficient conditions for existence are presented and an application to capacity expansion is given.Keywords
This publication has 6 references indexed in Scilit:
- Optimal capacity expansion under uncertaintyAdvances in Applied Probability, 1987
- Markov Processes1986
- Piecewise-Deterministic Markov Processes: A General Class of Non-Diffusion Stochastic ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 1984
- Discretization and Weak Convergence in Markov Decision Drift ProcessesMathematics of Operations Research, 1984
- Continuous time markov decision processes with interventionsStochastics, 1983
- Sufficient conditions for ergodicity and recurrence of Markov chains on a general state spaceStochastic Processes and their Applications, 1975