Approximations of the Optimal Importance Density Using Gaussian Particle Flow Importance Sampling
Authors:
- Pete BunchPBPete Bunch
- Simon GodsillSGSimon Godsill
- 2 April 2016
- journal article
- theory and-methods
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 111 (514) , 748-762
Abstract
Recently developed particle flow algorithms provide an alternative to importance sampling for drawing particles from a posterior distribution, and a number of particle filters based on this principle have been proposed. Samples are drawn from the prior and then moved according to some dynamics over an interval of pseudo-time such that their final values are distributed according to the desired posterior. In practice, implementing a particle flow sampler requires multiple layers of approximation, with the result that the final samples do not in general have the correct posterior distribution. In this article we consider using an approximate Gaussian flow for sampling with a class of nonlinear Gaussian models. We use the particle flow within an importance sampler, correcting for the discrepancy between the target and actual densities with importance weights. We present a suitable numerical integration procedure for use with this flow and an accompanying step-size control algorithm. In a filtering context, we use the particle flow to sample from the optimal importance density, rather than the filtering density itself, avoiding the need to make analytical or numerical approximations of the predictive density. Simulations using particle flow importance sampling within a particle filter demonstrate significant improvement over standard approximations of the optimal importance density, and the algorithm falls within the standard sequential Monte Carlo framework.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- A Gaussian‐mixture ensemble transform filterQuarterly Journal of the Royal Meteorological Society, 2011
- Particle Markov Chain Monte Carlo MethodsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- Sequential Monte Carlo SamplersJournal of the Royal Statistical Society Series B: Statistical Methodology, 2006
- Following a Moving Target—Monte Carlo Inference for Dynamic Bayesian ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2001
- Simulating normalizing constants: from importance sampling to bridge sampling to path samplingStatistical Science, 1998
- Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space ModelsJournal of Computational and Graphical Statistics, 1996
- Sequential Imputations and Bayesian Missing Data ProblemsJournal of the American Statistical Association, 1994
- Novel approach to nonlinear/non-Gaussian Bayesian state estimationIEE Proceedings F Radar and Signal Processing, 1993
- Bayesian Inference in Econometric Models Using Monte Carlo IntegrationEconometrica, 1989
- Algorithm 432 [C2]: Solution of the matrix equation AX + XB = C [F4]Communications of the ACM, 1972