Convergence analysis of the Gibbs sampler for Bayesian general linear mixed models with improper priors
Authors:
- Jorge Carlos RománJRJorge Carlos Román
- James P. HobertJHJames P. Hobert
Open Access
- 1 December 2012
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 40 (6) , 2823-2849
Abstract
Bayesian analysis of data from the general linear mixed model is challenging because any nontrivial prior leads to an intractable posterior density. However, if a conditionally conjugate prior density is adopted, then there is a simple Gibbs sampler that can be employed to explore the posterior density. A popular default among the conditionally conjugate priors is an improper prior that takes a product form with a flat prior on the regression parameter, and so-called power priors on each of the variance components. In this paper, a convergence rate analysis of the corresponding Gibbs sampler is undertaken. The main result is a simple, easily-checked sufficient condition for geometric ergodicity of the Gibbs–Markov chain. This result is close to the best possible result in the sense that the sufficient condition is only slightly stronger than what is required to ensure posterior propriety. The theory developed in this paper is extremely important from a practical standpoint because it guarantees the existence of central limit theorems that allow for the computation of valid asymptotic standard errors for the estimates computed using the Gibbs sampler.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Batch means and spectral variance estimators in Markov chain Monte CarloThe Annals of Statistics, 2010
- Markov Chain Monte Carlo: Can We Trust the Third Significant Figure?Statistical Science, 2008
- Stability of the Gibbs sampler for Bayesian hierarchical modelsThe Annals of Statistics, 2008
- A Few Remarks on “Fixed-Width Output Analysis for Markov Chain Monte Carlo” by Jones et alJournal of the American Statistical Association, 2007
- Fixed-Width Output Analysis for Markov Chain Monte CarloJournal of the American Statistical Association, 2006
- Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper)Bayesian Analysis, 2006
- General state space Markov chains and MCMC algorithmsProbability Surveys, 2004
- Markov Chains and De‐initializing ProcessesScandinavian Journal of Statistics, 2001
- A prior for the variance in hierarchical modelsCanadian Journal of Statistics, 1999
- Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemesBiometrika, 1994