The Bernstein-von Mises theorem and nonregular models
Authors:
- Natalia A. BochkinaNBNatalia A. Bochkina
- Peter J. GreenPGPeter J. Green
Preprint
Abstract
We study the asymptotic behaviour of the posterior distribution in a broad class of statistical models where the "true" solution occurs on the boundary of the parameter space. We show that in this case Bayesian inference is consistent, and that the posterior distribution has not only Gaussian components as in the case of regular models (the Bernstein-von Mises theorem) but also has Gamma distribution components whose form depends on the behaviour of the prior distribution near the boundary and have a faster rate of convergence. We also demonstrate a remarkable property of Bayesian inference, that for some models, there appears to be no bound on efficiency of estimating the unknown parameter if it is on the boundary of the parameter space. We illustrate the results on a problem from emission tomography.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Bayes and empirical Bayes: do they merge?Biometrika, 2014
- Consistency of the posterior distribution in generalized linear inverse problemsInverse Problems, 2013
- Parametric estimation. Finite sample theoryThe Annals of Statistics, 2012
- Consistency of the maximum likelihood estimator for general hidden Markov modelsThe Annals of Statistics, 2011
- Likelihood Estimation and Inference in a Class of Nonregular Econometric ModelsEconometrica, 2004
- Asymptotic Efficiency in Parametric Structural Models with Parameter-Dependent SupportEconometrica, 2003
- On the asymptotics of constrained local $M$-estimatorsThe Annals of Statistics, 2000
- Bayesian reconstructions from emission tomography data using a modified EM algorithmIEEE Transactions on Medical Imaging, 1990
- On the Statistical Analysis of Dirty PicturesJournal of the Royal Statistical Society Series B: Statistical Methodology, 1986
- Maximum-likelihood estimation in non-standard conditionsMathematical Proceedings of the Cambridge Philosophical Society, 1971