Recursive Adaptive Importance Sampling with Optimal Replenishment
Open Access
- 1 January 2026
- journal article
- Published by Institute of Mathematical Statistics in Bayesian Analysis
- Vol. -1 (-1) , 1-25
Abstract
Increased access to computing resources has led to the development of algorithms that can run efficiently on multi-core processing units or in distributed computing environments. In the context of Bayesian inference, many parallel computing approaches to fit statistical models have been proposed using Markov chain Monte Carlo methods, but they either have limited gains due to high latency cost or rely on model-specific decompositions. Alternatively, adaptive importance sampling, sequential Monte Carlo, and recursive Bayesian methods provide a parallel-friendly and asymptotically exact framework with well-developed theory for error estimation. We consider a recursive adaptive importance sampling approach that alternates between fast recursive weight updates and sample replenishment steps to balance computational effort while ensuring sample quality. A naive implementation can be unstable and inefficient, so we derive theoretical results to determine the optimal replenishment frequency based on the posterior concentration rate, thus attaining an asymptotically optimal trade-off. We demonstrate the efficacy of our method in simulated experiments and an application of sea surface temperature prediction in the Gulf of Mexico using Gaussian processes.Keywords
All Related Versions
This publication has 61 references indexed in Scilit:
- Annealed adaptive importance sampling method in PINNs for solving high dimensional partial differential equationsJournal of Computational Physics, 2024
- Convergence rates for optimised adaptive importance samplersStatistics and Computing, 2021
- A Case Study Competition Among Methods for Analyzing Large Spatial DataJournal of Agricultural, Biological and Environmental Statistics, 2018
- Markov chain importance sampling with applications to rare event probability estimationStatistics and Computing, 2011
- An adaptive sequential Monte Carlo method for approximate Bayesian computationStatistics and Computing, 2011
- Importance temperingStatistics and Computing, 2008
- Adaptive importance sampling in general mixture classesStatistics and Computing, 2008
- Parallelizing MCMC for Bayesian spatiotemporal geostatistical modelsStatistics and Computing, 2007
- Econometric illustrations of novel numerical integration strategies for Bayesian inferenceJournal of Econometrics, 1988
- Spatial Variation1986