Optimal Control for Continuous-Time Linear Quadratic Problems with Infinite Markov Jump Parameters
Authors:
- Marcelo D. FragosoMFMarcelo D. Fragoso
- Jack BaczynskiJBJack Baczynski
- 1 January 2001
- journal article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Control and Optimization
- Vol. 40 (1) , 270-297
Abstract
The subject matter of this paper is the optimal control problem for continuous-time linear systems subject to Markovian jumps in the parameters and the usual infinite-time horizon quadratic cost. What essentially distinguishes our problem from previous ones, inter alia, is that the Markov chain takes values on a countably infinite set. To tackle our problem, we make use of powerful tools from semigroup theory in Banach space and a decomplexification technique. The solution for the problem relies, in part, on the study of a countably infinite set of coupled algebraic Riccati equations (ICARE). Conditions for existence and uniqueness of a positive semidefinite solution of the ICARE are obtained via the extended concepts of stochastic stabilizability (SS) and stochastic detectability (SD). These concepts are couched into the theory of operators in Banach space and, parallel to the classical linear quadratic (LQ) case, bound up with the spectrum of a certain infinite dimensional linear operator.Keywords
This publication has 35 references indexed in Scilit:
- Integration of polynomial ordinary differential equations in the real planeAequationes mathematicae, 2001
- Stochastic stability and guaranteed cost control of discrete-time uncertain systems with Markovian jumping parametersInternational Journal of Robust and Nonlinear Control, 1998
- Mixed H/sub 2//H/sub ∞/-control of discrete-time Markovian jump linear systemsIEEE Transactions on Automatic Control, 1998
- Discrete-time LQ-optimal control problems for infinite Markov jump parameter systemsIEEE Transactions on Automatic Control, 1995
- Infinite Dimensional Analysis1994
- Stability Results for Discrete-Time Linear Systems with Markovian Jumping ParametersJournal of Mathematical Analysis and Applications, 1993
- The interacting multiple model algorithm for systems with Markovian switching coefficientsIEEE Transactions on Automatic Control, 1988
- A semigroup approach to the LQG problem for infinite-dimensional systemsIEEE Transactions on Circuits and Systems, 1978
- Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria †International Journal of Control, 1975
- Continuous-Time Regulation of a Class of Econometric ModelsIEEE Transactions on Systems, Man, and Cybernetics, 1975