Asymptotics for power posterior mean estimation
Preprint
Abstract
Power posteriors "robustify" standard Bayesian inference by raising the likelihood to a constant fractional power, effectively downweighting its influence in the calculation of the posterior. Power posteriors have been shown to be more robust to model misspecification than standard posteriors in many settings. Previous work has shown that power posteriors derived from low-dimensional, parametric locally asymptotically normal models are asymptotically normal (Bernstein-von Mises) even under model misspecification. We extend these results to show that the power posterior moments converge to those of the limiting normal distribution suggested by the Bernstein-von Mises theorem. We then use this result to show that the mean of the power posterior, a point estimator, is asymptotically equivalent to the maximum likelihood estimator.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Concentration of tempered posteriors and of their variational approximationsThe Annals of Statistics, 2020
- Bayesian fractional posteriorsThe Annals of Statistics, 2019
- Robust Bayesian Inference via CoarseningJournal of the American Statistical Association, 2018
- Inconsistency of Bayesian Inference for Misspecified Linear Models, and a Proposal for Repairing ItBayesian Analysis, 2017
- From ɛ-entropy to KL-entropy: Analysis of minimum information complexity density estimationThe Annals of Statistics, 2006
- PAC-Bayesian Stochastic Model SelectionMachine Learning, 2003
- On Bayesian ConsistencyJournal of the Royal Statistical Society Series B: Statistical Methodology, 2001