Weak detectability and the linear-quadratic control problem of discrete-time Markov jump linear systems
Authors:
- Eduardo F. CostaECEduardo F. Costa
- Joao B. R. Do ValJVJoao B. R. Do Val
- 1 January 2002
- journal article
- research article
- Published by Taylor & Francis in International Journal of Control
- Vol. 75 (16-17) , 1282-1292
Abstract
The paper deals with the stochastic concepts of weak detectability and weak observability for Markov jump linear systems, which is an special class of composite linear systems. The concepts are explored here to strengthen the similarities with the corresponding concepts of deterministic detectability and observability. We introduce a collection of matrices, referred to as the observability matrices. We show that weak observability is equivalent to full rank of each matrix in the set of observability matrices. In addition, we present a stochastic counterpart of the well known result on the invariance of trajectories within non-observable subspaces. These characterizations allow us to clarify the relationship between weak detectability and mean square detectability and to provide a testable condition for weak detectability. Relying on the assumption of weak detectability, we develop a method for solving the linear quadratic problem that is based on iterations of uncoupled algebraic Riccati equations, which converges to the solution of the coupled algebraic Riccati equation if and only if the system is mean-square stabilizable. Numerical examples are included.Keywords
This publication has 13 references indexed in Scilit:
- On the detectability and observability of discrete-time Markov jump linear systemsSystems & Control Letters, 2001
- Output feedback control of Markov jump linear systems in continuous-timeIEEE Transactions on Automatic Control, 2000
- Robust H 2-control for discrete-time Markovian jump linear systemsInternational Journal of Control, 2000
- Solutions for the Linear-Quadratic Control Problem of Markov Jump Linear SystemsJournal of Optimization Theory and Applications, 1999
- Receding horizon control of jump linear systems and a macroeconomic policy problemJournal of Economic Dynamics and Control, 1999
- Uncoupled Riccati iterations for the linear quadratic control problem of discrete-time Markov jump linear systemsIEEE Transactions on Automatic Control, 1998
- A convex programming approach to H2 control of discrete-time markovian jump linear systemsInternational Journal of Control, 1997
- On the solution of discrete-time Markovian jump linear quadratic control problemsAutomatica, 1995
- Discrete-time LQ-optimal control problems for infinite Markov jump parameter systemsIEEE Transactions on Automatic Control, 1995
- Stability Results for Discrete-Time Linear Systems with Markovian Jumping ParametersJournal of Mathematical Analysis and Applications, 1993