Fast and Numerically Stable Particle-Based Online Additive Smoothing: The AdaSmooth Algorithm
Open Access
- 10 October 2022
- journal article
- research article
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 119 (545) , 356-367
Abstract
We present a novel sequential Monte Carlo approach to online smoothing of additive functionals in a very general class of path-space models. Hitherto, the solutions proposed in the literature suffer from either long-term numerical instability due to particle-path degeneracy or, in the case that degeneracy is remedied by particle approximation of the so-called backward kernel, high computational demands. In order to balance optimally computational speed against numerical stability, we propose to furnish a (fast) naive particle smoother, propagating recursively a sample of particles and associated smoothing statistics, with an adaptive backward-sampling-based updating rule which allows the number of (costly) backward samples to be kept at a minimum. This yields a new, function-specific additive smoothing algorithm, AdaSmooth, which is computationally fast, numerically stable and easy to implement. The algorithm is provided with rigorous theoretical results guaranteeing its consistency, asymptotic normality and long-term stability as well as numerical results demonstrating empirically the clear superiority of AdaSmooth to existing algorithms.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- On adaptive resampling strategies for sequential Monte Carlo methodsBernoulli, 2012
- Sequential Monte Carlo smoothing for general state space hidden Markov modelsThe Annals of Applied Probability, 2011
- Particle approximations of the score and observed information matrix in state space models with application to parameter estimationBiometrika, 2011
- Online EM Algorithm for Hidden Markov ModelsJournal of Computational and Graphical Statistics, 2011
- A backward particle interpretation of Feynman-Kac formulaeESAIM: Mathematical Modelling and Numerical Analysis, 2010
- Online Learning with Hidden Markov ModelsNeural Computation, 2008
- Sequential Monte Carlo smoothing with application to parameter estimation in nonlinear state space modelsBernoulli, 2008
- Filtering via Simulation: Auxiliary Particle FiltersJournal of the American Statistical Association, 1999
- Metropolized independent sampling with comparisons to rejection sampling and importance samplingStatistics and Computing, 1996
- Novel approach to nonlinear/non-Gaussian Bayesian state estimationIEE Proceedings F Radar and Signal Processing, 1993