Convergence rates for MCMC algorithms for a robust Bayesian binary regression model
Open Access
- 1 January 2012
- journal article
- research article
- Published by Institute of Mathematical Statistics in Electronic Journal of Statistics
- Vol. 6 (none) , 2463-2485
Abstract
Most common regression models for analyzing binary random variables are logistic and probit regression models. However it is well known that the estimates of regression coefficients for these models are not robust to outliers [26]. The robit regression model [1, 16] is a robust alternative to the probit and logistic models. The robit model is obtained by replacing the normal (logistic) distribution underlying the probit (logistic) regression model with the Student’s $t-$distribution. We consider a Bayesian analysis of binary data with the robit link function. We construct a data augmentation (DA) algorithm that can be used to explore the corresponding posterior distribution. Following [10] we further improve the DA algorithm by adding a simple extra step to each iteration. Though the two algorithms are basically equivalent in terms of computational complexity, the second algorithm is theoretically more efficient than the DA algorithm. Moreover, we analyze the convergence rates of these Markov chain Monte Carlo (MCMC) algorithms. We prove that, under certain conditions, both algorithms converge at a geometric rate. The geometric convergence rate has important theoretical and practical ramifications. Indeed, the geometric ergodicity guarantees that the ergodic averages used to approximate posterior expectations satisfy central limit theorems, which in turn allows for the construction of asymptotically valid standard errors. These standard errors can be used to choose an appropriate (Markov chain) Monte Carlo sample size and allow one to use the MCMC algorithms developed in this paper with the same level of confidence that one would have using classical (iid) Monte Carlo. The results are illustrated using a simple numerical example.Keywords
This publication has 36 references indexed in Scilit:
- To Center or Not to Center: That Is Not the Question—An Ancillarity–Sufficiency Interweaving Strategy (ASIS) for Boosting MCMC EfficiencyJournal of Computational and Graphical Statistics, 2011
- Markov Chain Monte Carlo: Can We Trust the Third Significant Figure?Statistical Science, 2008
- A Few Remarks on “Fixed-Width Output Analysis for Markov Chain Monte Carlo” by Jones et alJournal of the American Statistical Association, 2007
- Fixed-Width Output Analysis for Markov Chain Monte CarloJournal of the American Statistical Association, 2006
- Bayesian auxiliary variable models for binary and multinomial regressionBayesian Analysis, 2006
- Robit Regression: A Simple Robust Alternative to Logistic and Probit Regression2004
- Parameter Expansion for Data AugmentationJournal of the American Statistical Association, 1999
- Bayesian Analysis of Binary and Polychotomous Response DataJournal of the American Statistical Association, 1993
- The Calculation of Posterior Distributions by Data AugmentationJournal of the American Statistical Association, 1987
- Tail Areas of the t-Distribution from a Mills'-Ratio-Like ExpansionThe Annals of Mathematical Statistics, 1963