A strategy to avoid particle depletion in recursive Bayesian inference
Preprint
Abstract
Recursive Bayesian inference, in which posterior beliefs are updated in light of accumulating data, is a tool for implementing Bayesian models in applications with streaming and/or very large data sets. As the posterior of one iteration becomes the prior for the next, beliefs are updated sequentially instead of all-at-once. Thus, recursive inference is relevant for both streaming data and settings where data too numerous to be analyzed together can be partitioned into manageable pieces. In practice, posteriors are characterized by samples obtained using, e.g., acceptance/rejection sampling in which draws from the posterior of one iteration are used as proposals for the next. While simple to implement, such filtering approaches suffer from particle depletion, degrading each sample's ability to represent its target posterior. As a remedy, we investigate generating proposals from a smoothed version of the preceding sample's empirical distribution. The method retains computationally valuable properties of similar methods, but without particle depletion, and we demonstrate its accuracy in simulation. We apply the method to data simulated from both a simple, logistic regression model as well as a hierarchical model originally developed for classifying forest vegetation in New Mexico using satellite imagery.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Predicting species-level vegetation cover using large satellite imagery data setsJournal of Agricultural, Biological and Environmental Statistics, 2024
- Making Recursive Bayesian Inference AccessibleThe American Statistician, 2019
- Programming With Models: Writing Statistical Algorithms for General Model Structures With NIMBLEJournal of Computational and Graphical Statistics, 2017
- Stan: A Probabilistic Programming Language2017
- brms: An R Package for Bayesian Multilevel Models Using Stan2017
- Mapping forest functional type in a forest-shrubland ecotone using SPOT imagery and predictive habitat distribution modellingRemote Sensing Letters, 2015
- Fully Bayesian Hierarchical Modelling in Two Stages, with Application to Meta-AnalysisJournal of the Royal Statistical Society Series C: Applied Statistics, 2013
- Particle Markov Chain Monte Carlo MethodsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- Explaining species distribution patterns through hierarchical modelingBayesian Analysis, 2006
- Predicting species distribution: offering more than simple habitat modelsEcology Letters, 2005