Approximations of the Optimal Importance Density using Gaussian Particle Flow Importance Sampling
Authors:
- Pete BunchPBPete Bunch
- Simon GodsillSGSimon Godsill
Preprint
Abstract
Recently developed particle flow algorithms provide an alternative to importance sampling for drawing particles from a posterior distribution, and a number of particle filters based on this principle have been proposed. Samples are drawn from the prior and then moved according to some dynamics over an interval of pseudo-time such that their final values are distributed according to the desired posterior. In practice, implementing a particle flow sampler requires multiple layers of approximation, with the result that the final samples do not in general have the correct posterior distribution. In this paper we consider using an approximate Gaussian flow for sampling with a class of nonlinear Gaussian models. We use the particle flow within an importance sampler, correcting for the discrepancy between the target and actual densities with importance weights. We present a suitable numerical integration procedure for use with this flow and an accompanying step-size control algorithm. In a filtering context, we use the particle flow to sample from the optimal importance density, rather than the filtering density itself, avoiding the need to make analytical or numerical approximations of the predictive density. Simulations using particle flow importance sampling within a particle filter demonstrate significant improvement over standard approximations of the optimal importance density, and the algorithm falls within the standard sequential Monte Carlo framework.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- A Gaussian‐mixture ensemble transform filterQuarterly Journal of the Royal Meteorological Society, 2011
- Interacting and Annealing Particle Filters: Mathematics and a Recipe for ApplicationsJournal of Mathematical Imaging and Vision, 2007
- Sequential Monte Carlo SamplersJournal of the Royal Statistical Society Series B: Statistical Methodology, 2006
- Marginalized particle filters for mixed linear/nonlinear state-space modelsIEEE Transactions on Signal Processing, 2005
- Progressive Bayesian estimation for nonlinear discrete-time systems:the filter step for scalar measurements and multidimensional states2004
- Monte Carlo Strategies in Scientific Computing2004
- Annealed importance samplingStatistics and Computing, 2001
- Following a Moving Target—Monte Carlo Inference for Dynamic Bayesian ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2001
- Improvement Strategies for Monte Carlo Particle Filters2001
- On sequential Monte Carlo sampling methods for Bayesian filteringStatistics and Computing, 2000