Sequential Bayesian parameter-state estimation in dynamical systems with noisy and incomplete observations via a variational framework
Authors:
Preprint
Abstract
Online joint estimation of unknown parameters and states in a dynamical system with uncertainty quantification is crucial in many applications. For example, digital twins dynamically update their knowledge of model parameters and states to support prediction and decision-making. Reliability and computational speed are vital for DTs. Online parameter-state estimation ensures computational efficiency, while uncertainty quantification is essential for making reliable predictions and decisions. In parameter-state estimation, the joint distribution of the state and model parameters conditioned on the data, termed the joint posterior, provides accurate uncertainty quantification. Because the joint posterior is generally intractable to compute, this paper presents an online variational inference framework to compute its approximation at each time step. The approximation is factorized into a marginal distribution over the model parameters and a state distribution conditioned on the parameters. This factorization enables recursive updates through a two-stage procedure: first, the parameter posterior is approximated via variational inference; second, the state distribution conditioned on the parameters is computed using Gaussian filtering based on the estimated parameter posterior. The algorithmic design is supported by a theorem establishing upper bounds on the joint posterior approximation error. Numerical experiments demonstrate that the proposed method (i) matches the performance of the joint particle filter in low-dimensional problems, accurately inferring both unobserved states and unknown parameters of dynamical and observation models; (ii) remains robust under noisy, partial observations and model discrepancies in a chaotic Lorenz 96 system; and (iii) scales effectively to a high-dimensional convection-diffusion system, where it outperforms the joint ensemble Kalman filter.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Joint state-parameter estimation for the reduced fracture model via the united filterJournal of Computational Physics, 2025
- Projected data assimilation using sliding window proper orthogonal decompositionJournal of Computational Physics, 2024
- An information field theory approach to Bayesian state and parameter estimation in dynamical systemsJournal of Computational Physics, 2024
- Variational State and Parameter EstimationIFAC-PapersOnLine, 2021
- Variational Inference: A Review for StatisticiansJournal of the American Statistical Association, 2017
- An Improved Dual Unscented Kalman Filter for State and Parameter EstimationAsian Journal of Control, 2015
- Joint unscented Kalman filter for state and parameter estimation in vehicle dynamics2015
- Real‐time groundwater flow modeling with the Ensemble Kalman Filter: Joint estimation of states and parameters and the filter inbreeding problemWater Resources Research, 2008
- System Identification Based on Online Variational Bayes Method and Its Application to Reinforcement Learning2003
- Gaussian filters for nonlinear filtering problemsIEEE Transactions on Automatic Control, 2000