Maximum-likelihood parameter estimation of bilinear systems
Authors:
- A. WillsAWA. Wills
- B. NinnessBNB. Ninness
- 10 October 2005
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 50 (10) , 1581-1596
Abstract
This paper addresses the problem of estimating the parameters in a multivariable bilinear model on the basis of observed input-output data. The main contribution is to develop, analyze, and empirically study new techniques for computing a maximum-likelihood based solution. In particular, the emphasis here is on developing practical methods that are illustrated to be numerically reliable, robust to choice of initialization point, and numerically efficient in terms of how computation and memory requirements scale relative to problem size. This results in new methods that can be reliably deployed on systems of nontrivial state, input and output dimension. Underlying these developments is a new approach (in this context) of employing the expectation-maximization method as a means for robust and gradient free computation of the maximum-likelihood solution.Keywords
This publication has 37 references indexed in Scilit:
- Data driven local coordinates for multivariable linear systems and their application to system identificationAutomatica, 2004
- Identification of bilinear systems using Bayesian inference2002
- Numerical Optimization1999
- System identification using an over-parametrized model class-improving the optimization algorithm1999
- The EM Algorithm—an Old Folk-song Sung to a Fast New TuneJournal of the Royal Statistical Society Series B: Statistical Methodology, 1997
- Sparse Matrix Inversion for Restricted Maximum Likelihood Estimation of Variance Components by Expectation-MaximizationJournal of Dairy Science, 1993
- Extensions of estimation methods using the EM algorithmJournal of Econometrics, 1991
- AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHMJournal of Time Series Analysis, 1982
- Second-order correlation method for bilinear system identificationIEEE Transactions on Automatic Control, 1980
- A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov ChainsThe Annals of Mathematical Statistics, 1970