Ensemble-localized Kernel Density Estimation with Applications to the Ensemble Gaussian Mixture Filter
Preprint
Abstract
The ensemble Gaussian mixture filter (EnGMF) is a powerful filter for highly non-Gaussian and non-linear models that has practical utility in the case of a small number of samples, and theoretical convergence to full Bayesian inference in the ensemble limit. We aim to increase the utility of the EnGMF by introducing an ensemble-local notion of covariance into the kernel density estimation (KDE) step for the prior distribution. We prove that in the Gaussian case, our new ensemble-localized KDE technique is exactly the same as more traditional KDE techniques. We also show an example of a non-Gaussian distribution that can fail to be approximated by canonical KDE methods, but can be approximated exactly by our new KDE technique. We showcase our new KDE technique on a simple bivariate problem, showing that it has nice qualitative and quantitative properties, and significantly improves the estimate of the prior and posterior distributions for all ensemble sizes tested. We additionally show the utility of the proposed methodology for sequential filtering for the Lorenz '63 equations, achieving a significant reduction in error, and less conservative behavior in the uncertainty estimate with respect to traditional techniques.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- An Adaptive Covariance Parameterization Technique for the Ensemble Gaussian Mixture FilterSIAM Journal on Scientific Computing, 2024
- Kernel-based ensemble gaussian mixture filtering for orbit determination with sparse dataAdvances In Space Research, 2022
- Clustering Methods for Particle Filters With Gaussian Mixture ModelsIEEE Transactions on Aerospace and Electronic Systems, 2021
- A tutorial on kernel density estimation and recent advancesBiostatistics & Epidemiology, 2017
- Gaussian Mixture Nonlinear Filtering With Resampling for Mixand NarrowingIEEE Transactions on Signal Processing, 2016
- Probabilistic Forecasting and Bayesian Data Assimilation2015
- A Nonparametric Ensemble Transform Method for Bayesian InferenceSIAM Journal on Scientific Computing, 2013
- Numerical Techniques for Approximating Lyapunov Exponents and Their ImplementationJournal of Computational and Nonlinear Dynamics, 2010
- Scale measures for bandwidth selectionJournal of Nonparametric Statistics, 1995
- Nonlinear Bayesian estimation using Gaussian sum approximationsIEEE Transactions on Automatic Control, 1972