Denumerable state continuous time Markov decision processes with unbounded cost and transition rates under average criterion
Authors:
- 1 April 2002
- journal article
- research article
- Published by Cambridge University Press (CUP) in The ANZIAM Journal
- Vol. 43 (4) , 541-557
Abstract
In this paper, we consider denumerable state continuous time Markov decision processes with (possibly unbounded) transition and cost rates under average criterion. We present a set of conditions and prove the existence of both average cost optimal stationary policies and a solution of the average optimality equation under the conditions. The results in this paper are applied to an admission control queue model and controlled birth and death processes.Keywords
This publication has 13 references indexed in Scilit:
- Another set of conditions for average optimality in Markov control processesSystems & Control Letters, 1995
- Continuous-Time Markov Chains1991
- Continuous time Markov decision programming with average reward criterion and unbounded reward rateActa Mathematicae Applicatae Sinica, English Series, 1991
- Average Cost Optimal Stationary Policies in Infinite State Markov Decision Processes with Unbounded CostsOperations Research, 1989
- Optimal control of random walks, birth and death processes, and queuesAdvances in Applied Probability, 1981
- Optimal stationary policies for denumerable Markov chains in continuous timeAdvances in Applied Probability, 1976
- On Maximal Rewards and $|varepsilon$-Optimal Policies in Continuous Time Markov Decision ChainsThe Annals of Statistics, 1974
- Nondiscounted Continuous Time Markovian Decision Process with Countable State SpaceSIAM Journal on Control, 1972
- Finite state continuous time Markov decision processes with an infinite planning horizonJournal of Mathematical Analysis and Applications, 1968
- Markov Chains with Stationary Transition Probabilities1960