Limit theorems for sequential MCMC methods
Authors:
- 1 June 2020
- journal article
- research article
- Published by Cambridge University Press (CUP) in Advances in Applied Probability
- Vol. 52 (2) , 377-403
Abstract
Both sequential Monte Carlo (SMC) methods (a.k.a. ‘particle filters’) and sequential Markov chain Monte Carlo (sequential MCMC) methods constitute classes of algorithms which can be used to approximate expectations with respect to (a sequence of) probability distributions and their normalising constants. While SMC methods sample particles conditionally independently at each time step, sequential MCMC methods sample particles according to a Markov chain Monte Carlo (MCMC) kernel. Introduced over twenty years ago in [6], sequential MCMC methods have attracted renewed interest recently as they empirically outperform SMC methods in some applications. We establish an $\mathbb{L}_r$ -inequality (which implies a strong law of large numbers) and a central limit theorem for sequential MCMC methods and provide conditions under which errors can be controlled uniformly in time. In the context of state-space models, we also provide conditions under which sequential MCMC methods can indeed outperform standard SMC methods in terms of asymptotic variance of the corresponding Monte Carlo estimators.
Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- On nonlinear Markov chain Monte CarloBernoulli, 2011
- Sequentially interacting Markov chain Monte Carlo methodsThe Annals of Statistics, 2010
- Interacting Markov chain Monte Carlo methods for solving nonlinear measure-valued equationsThe Annals of Applied Probability, 2010
- The pseudo-marginal approach for efficient Monte Carlo computationsThe Annals of Statistics, 2009
- Renewal theory and computable convergence rates for geometrically ergodic Markov chainsThe Annals of Applied Probability, 2005
- Central limit theorem for sequential Monte Carlo methods and its application to Bayesian inferenceThe Annals of Statistics, 2004
- Filtering via Simulation: Auxiliary Particle FiltersJournal of the American Statistical Association, 1999
- Foundations of Modern ProbabilityJournal of the American Statistical Association, 1998
- Dynamic Conditional Independence Models and Markov Chain Monte Carlo MethodsJournal of the American Statistical Association, 1997
- Novel approach to nonlinear/non-Gaussian Bayesian state estimationIEE Proceedings F Radar and Signal Processing, 1993