Nonlinear Bayesian Filtering With N atural Gr a dient Gaussia n Appr o ximation
- 1 July 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 48 (7) , 8581-8597
Abstract
Practical Bayes filters often assume the state distribution of each time step to be Gaussian for computational tractability, resulting in the so-called Gaussian filters. When facing nonlinear systems, Gaussian filters such as extended Kalman filter (EKF) or unscented Kalman filter (UKF) typically rely on certain linearization techniques, which can introduce large estimation errors. To address this issue, this paper reconstructs the prediction and update steps of Gaussian filtering as solutions to two distinct optimization problems, whose optimal conditions are found to have analytical forms from Stein's lemma. It is observed that the stationary point for the prediction step requires calculating the first two moments of the prior distribution, which is equivalent to that step in existing moment-matching filters. In the update step, instead of linearizing the model to approximate the stationary points, we propose an iterative approach to directly minimize the update step's objective to avoid linearization errors. For the purpose of performing the steepest descent on the Gaussian manifold, we derive its natural gradient that leverages Fisher information matrix to adjust the gradient direction, accounting for the curvature of the parameter space. Combining this update step with moment matching in the prediction step, we introduce a new iterative filter for nonlinear systems called Natural Gradient Gaussian Approximation filter, or NANO filter for short. We prove that NANO filter locally converges to the optimal Gaussian approximation at each time step. Furthermore, the estimation error is proven exponentially bounded for nearly linear measurement equation and low noise levels through constructing a supermartingale-like property across consecutive time steps. Real-world experiments demonstrate that, compared to popular Gaussian filters such as EKF, UKF, iterated EKF, and posterior linearization filter, NANO filter reduces the average root mean square error by approximately 45% while maintaining a comparable computational burden.Keywords
All Related Versions
Funding Information
- NSF China (92582205)
- Beijing Natural Science Foundation (L257002)
- Tsinghua University-Toyota Joint Research Center for AI Technology of Automated Vehicle
This publication has 43 references indexed in Scilit:
- State Estimation for Robotics2024
- Bayesian Filtering and Smoothing2023
- Stochastic stability and performance analysis of Cubature Kalman FilterNeurocomputing, 2016
- Robust Statistics2011
- Statistics on the Manifold of Multivariate Normal Distributions: Theory and Application to Diffusion Tensor MRI ProcessingJournal of Mathematical Imaging and Vision, 2006
- The synchronization of chaotic systemsPhysics Reports, 2002
- Nonlinear filtering: Interacting particle resolutionComptes Rendus de l'Académie des Sciences - Series I - Mathematics, 1997
- Robust Estimation of a Location Parameter1992
- Stochastic Processes and Filtering Theory1970
- Transformations des signaux aléatoires a travers les systèmes non linéaires sans mémoireAnnals of Telecommunications, 1964