Posterior contraction in sparse generalized linear models
Authors:
- 14 September 2020
- journal article
- research article
- Published by Oxford University Press (OUP) in Biometrika
- Vol. 108 (2) , 367-379
Abstract
Summary: We study posterior contraction rates in sparse high-dimensional generalized linear models using priors incorporating sparsity. A mixture of a point mass at zero and a continuous distribution is used as the prior distribution on regression coefficients. In addition to the usual posterior, the fractional posterior, which is obtained by applying Bayes theorem with a fractional power of the likelihood, is also considered. The latter allows uniformity in posterior contraction over a larger subset of the parameter space. In our set-up, the link function of the generalized linear model need not be canonical. We show that Bayesian methods achieve convergence properties analogous to lasso-type procedures. Our results can be used to derive posterior contraction rates in many generalized linear models including logistic, Poisson regression and others.Keywords
This publication has 25 references indexed in Scilit:
- A Unified Framework for High-Dimensional Analysis of $M$-Estimators with Decomposable RegularizersStatistical Science, 2012
- Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequencesThe Annals of Statistics, 2012
- Kullback–Leibler aggregation and misspecified generalized linear modelsThe Annals of Statistics, 2012
- High-dimensional generalized linear models and the lassoThe Annals of Statistics, 2008
- Mixtures of g Priors for Bayesian Variable SelectionJournal of the American Statistical Association, 2008
- Bayesian variable selection for high dimensional generalized linear models: Convergence rates of the fitted densitiesThe Annals of Statistics, 2007
- Convergence rates of posterior distributions for noniid observationsThe Annals of Statistics, 2007
- From ɛ-entropy to KL-entropy: Analysis of minimum information complexity density estimationThe Annals of Statistics, 2006
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determinationBiometrika, 1995
- Bayesian Analysis of Binary and Polychotomous Response DataJournal of the American Statistical Association, 1993