Optimal control of a class of piecewise deterministic processes
- 30 July 2013
- journal article
- research article
- Published by Cambridge University Press (CUP) in European Journal of Applied Mathematics
- Vol. 25 (1) , 1-25
Abstract
A new control strategy for a class of piecewise deterministic processes (PDP) is presented. In this class, PDP stochastic processes consist of ordinary differential equations that are subject to random switches corresponding to a discrete Markov process. The proposed strategy aims at controlling the probability density function (PDF) of the PDP. The optimal control formulation is based on the hyperbolic Fokker–Planck system that governs the time evolution of the PDF of the PDP and on tracking objectives of terminal configuration with a target PDF. The corresponding optimization problems are formulated as a sequence of open-loop hyperbolic optimality systems following a model predictive control framework. These systems are discretized by first-order schemes that guarantee positivity and conservativeness of the numerical PDF solution. The effectiveness of the proposed computational control framework is validated considering PDP with dichotomic noise.Keywords
This publication has 35 references indexed in Scilit:
- OPTIMAL CONTROL OF PROBABILITY DENSITY FUNCTIONS OF STOCHASTIC PROCESSESMathematical Modelling and Analysis, 2010
- MDP algorithms for portfolio optimization problems in pure jump marketsFinance and Stochastics, 2009
- An implicit finite volume scheme for a scalar hyperbolic problem with measure data related to piecewise deterministic Markov processesJournal of Computational and Applied Mathematics, 2008
- A FINITE DIFFERENCE METHOD FOR PIECEWISE DETERMINISTIC PROCESSES WITH MEMORYMathematical Modelling and Analysis, 2007
- A finite-volume scheme for dynamic reliability modelsIMA Journal of Numerical Analysis, 2006
- Impulse Control of Piecewise Deterministic Markov ProcessesThe Annals of Applied Probability, 1995
- Receding horizon control of nonlinear systemsIEEE Transactions on Automatic Control, 1990
- Free Brownian motion of a particle driven by a dichotomous random forcePhysical Review A, 1990
- On filtered binary processesIEEE Transactions on Information Theory, 1986
- On an optimal control problem involving first order hyperbolic systems with boundary controlsNumerical Functional Analysis and Optimization, 1982