Improving power posterior estimation of statistical evidence
Preprint
Abstract
The statistical evidence (or marginal likelihood) is a key quantity in Bayesian statistics, allowing one to assess the probability of the data given the model under investigation. This paper focuses on refining the power posterior approach to improve estimation of the evidence. The power posterior method involves transitioning from the prior to the posterior by powering the likelihood by an inverse temperature. In common with other tempering algorithms, the power posterior involves some degree of tuning. The main contributions of this article are twofold -- we present a result from the numerical analysis literature which can reduce the bias in the estimate of the evidence by addressing the error arising from numerically integrating across the inverse temperatures. We also tackle the selection of the inverse temperature ladder, applying this approach additionally to the Stepping Stone sampler estimation of evidence.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Improving Marginal Likelihood Estimation for Bayesian Phylogenetic Model SelectionSystematic Biology, 2010
- Tuning tempered transitionsStatistics and Computing, 2010
- A path sampling identity for computing the Kullback–Leibler and J divergencesComputational Statistics & Data Analysis, 2010
- Estimating Bayes factors via thermodynamic integration and population MCMCComputational Statistics & Data Analysis, 2009
- Marginal Likelihood Estimation via Power PosteriorsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Nested sampling for general Bayesian computationBayesian Analysis, 2006
- Computing Bayes Factors Using Thermodynamic IntegrationSystematic Biology, 2006
- Annealed importance samplingStatistics and Computing, 2001
- On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion)Journal of the Royal Statistical Society Series B: Statistical Methodology, 1997