Implicitly adaptive importance sampling
Open Access
- 9 February 2021
- journal article
- research article
- Published by Springer Nature in Statistics and Computing
- Vol. 31 (2) , 1-19
Abstract
Adaptive importance sampling is a class of techniques for finding good proposal distributions for importance sampling. Often the proposal distributions are standard probability distributions whose parameters are adapted based on the mismatch between the current proposal and a target distribution. In this work, we present an implicit adaptive importance sampling method that applies to complicated distributions which are not available in closed form. The method iteratively matches the moments of a set of Monte Carlo draws to weighted moments based on importance weights. We apply the method to Bayesian leave-one-out cross-validation and show that it performs better than many existing parametric adaptive importance sampling methods while being computationally inexpensive.Keywords
All Related Versions
Funding Information
- Aalto-Yliopisto
- Research Council of Finland (298742, 313122)
This publication has 47 references indexed in Scilit:
- Truncated Importance SamplingJournal of Computational and Graphical Statistics, 2008
- Case-deletion importance sampling estimators: Central limit theorems and related resultsElectronic Journal of Statistics, 2008
- Strictly Proper Scoring Rules, Prediction, and EstimationJournal of the American Statistical Association, 2007
- Population Monte CarloJournal of Computational and Graphical Statistics, 2004
- Warp Bridge SamplingJournal of Computational and Graphical Statistics, 2002
- Safe and Effective Importance SamplingJournal of the American Statistical Association, 2000
- On the Variability of Case-Deletion Importance Sampling Weights in the Bayesian Linear ModelJournal of the American Statistical Association, 1997
- Nonparametric Importance SamplingJournal of the American Statistical Association, 1996
- Weighted Average Importance Sampling and Defensive Mixture DistributionsTechnometrics, 1995
- A Predictive Approach to Model SelectionJournal of the American Statistical Association, 1979