Bayesian linear regression with sparse priors
Authors:
- Ismaël CastilloICIsmaël Castillo
- Johannes Schmidt-HieberJSJohannes Schmidt-Hieber
- Aad van der VaartAVAad van der Vaart
Top Cited Papers
Open Access
- 1 October 2015
- journal article
- research article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 43 (5) , 1986-2018
Abstract
We study full Bayesian procedures for high-dimensional linear regression under sparsity constraints. The prior is a mixture of point masses at zero and continuous distributions. Under compatibility conditions on the design matrix, the posterior distribution is shown to contract at the optimal rate for recovery of the unknown sparse vector, and to give optimal prediction of the response vector. It is also shown to select the correct sparse model, or at least the coefficients that are significantly different from zero. The asymptotic shape of the posterior distribution is characterized and employed to the construction and study of credible sets for uncertainty quantification.Keywords
All Related Versions
This publication has 48 references indexed in Scilit:
- Correlated variables in regression: Clustering and sparse estimationJournal of Statistical Planning and Inference, 2013
- Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequencesThe Annals of Statistics, 2012
- ESS++: a C++ objected-oriented algorithm for Bayesian stochastic search model explorationBioinformatics, 2011
- Variable selection for discriminant analysis with Markov random field priors for the analysis of microarray dataBioinformatics, 2010
- Bayesian variable selection via particle stochastic searchStatistics & Probability Letters, 2010
- Oracle convergence rate of posterior under projection prior and Bayesian model selectionMathematical Methods of Statistics, 2010
- Sparsity oracle inequalities for the LassoElectronic Journal of Statistics, 2007
- Spike and slab variable selection: Frequentist and Bayesian strategiesThe Annals of Statistics, 2005
- The Variable Selection ProblemJournal of the American Statistical Association, 2000
- Bayesian Variable Selection in Linear RegressionJournal of the American Statistical Association, 1988