Recursive Identification of the ARARX Model Based on the Variational Bayes Method
- 13 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 17, 4215-4222
Abstract
Bayesian parameter estimation of autoregressive (AR) with exogenous input (X) systems in the presence of colored model noise is addressed. The stochastic system under consideration is driven by colored noise that arises from passing an initially white noise through an AR filter. Owing to the additional AR filter, the ARARX schema provides more flexibility than the ARX one. The gained flexibility is countered by the fact that the ARARX system is no longer linear-in-parameters unless the white noise components or the AR noise filter are available. This paper analyzes the problem of estimating the unknown coefficients of the ARARX system and the model noise precision under conditions where the AR noise filter is both available and unavailable. While the former condition reduces the estimation problem to standard linear least squares, the latter one gives rise to an analytically intractable estimation problem. The intractability is resolved by the distributional approximation technique based on the variational Bayes (VB) method.Keywords
Funding Information
- Czech Science Foundation (23-06476S)
This publication has 24 references indexed in Scilit:
- Variational Bayesian Learning Theory2019
- Parameter identifiability with Kullback–Leibler information divergence criterionInternational Journal of Adaptive Control and Signal Processing, 2008
- Estimation and prediction with ARMMAX model: a mixture of ARMAX models with common ARX partInternational Journal of Adaptive Control and Signal Processing, 2003
- Matrix Calculus and Zero-One Matrices2001
- Common factor detection and estimationAutomatica, 1997
- Towards fully probabilistic control designAutomatica, 1996
- Decomposition methods for solving least-squares parameter estimationIEEE Transactions on Signal Processing, 1996
- An indirect prediction error method for system identificationAutomatica, 1991
- On reparametrization of loss functions used in estimation and the invariance principleSignal Processing, 1989
- Symmetry, 0-1 Matrices and Jacobians: A ReviewEconometric Theory, 1986