Recursive estimation of transition probabilities for jump Markov linear systems under minimum Kullback–Leibler divergence criterion
Authors:
Open Access
- 1 November 2015
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Control Theory & Applications
- Vol. 9 (17) , 2491-2499
Abstract
To reduce the computational complexity of the well‐established recursive Kullback–Leibler (RKL) method for real‐time applications, a recursive estimation method of the unknown transition probabilities (TPs) for the jump Markov linear system (JMLS) is developed in this study. The authors first explore an underlying idea that the RKL estimate of a diagonally dominant TP matrix (TPM) can be constructed by the estimate of each row vector of the TPM under the minimum K–L divergence criterion using observations at specific time steps. A modified derivation of the numerical solution to the RKL estimate that can avoid redundant likelihood computations is then exploited to estimate the specific row vector of the TPM per time step. The developed TP estimation method is computationally more efficient than either the RKL method or the maximum likelihood method, in particular for the JMLS defined over a high‐dimensional state space or a multi‐dimensional model space. The effectiveness of the developed TP estimation method is verified through a numerical example.Keywords
Funding Information
- National Natural Science Foundation of China (61201459, 61374019, 11173010)
This publication has 23 references indexed in Scilit:
- An online sequential algorithm for the estimation of transition probabilities for jump Markov linear systemsAutomatica, 2006
- Online Bayesian Estimation of Transition Probabilities for Markovian Jump SystemsIEEE Transactions on Signal Processing, 2004
- Interacting multiple model particle filterIEE Proceedings - Radar, Sonar and Navigation, 2003
- Recursive state estimation for multiple switching models with unknown transition probabilitiesIEEE Transactions on Aerospace and Electronic Systems, 2002
- MAP estimation of target manoeuvre sequence with the expectation-maximization algorithmIEEE Transactions on Aerospace and Electronic Systems, 2002
- IMM algorithm and aperiodic data1992
- Radar target tracking-Viterbi versus IMMIEEE Transactions on Aerospace and Electronic Systems, 1991
- The interacting multiple model algorithm for systems with Markovian switching coefficientsIEEE Transactions on Automatic Control, 1988
- Adaptive estimation and identification for discrete systems with Markov jump parametersIEEE Transactions on Automatic Control, 1982
- On state estimation in switching environmentsIEEE Transactions on Automatic Control, 1970