Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models
- 8 June 2020
- journal article
- research article
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 117 (537) , 184-197
Abstract
We introduce the spike-and-slab group lasso (SSGL) for Bayesian estimation and variable selection in linear regression with grouped variables. We further extend the SSGL to sparse generalized additive models (GAMs), thereby introducing the first nonparametric variant of the spike-and-slab lasso methodology. Our model simultaneously performs group selection and estimation, while our fully Bayes treatment of the mixture proportion allows for model complexity control and automatic self-adaptivity to different levels of sparsity. We develop theory to uniquely characterize the global posterior mode under the SSGL and introduce a highly efficient block coordinate ascent algorithm for maximum a posteriori (MAP) estimation. We further employ de-biasing methods to provide uncertainty quantification of our estimates. Thus, implementation of our model avoids the computational intensiveness of Markov chain Monte Carlo (MCMC) in high dimensions. We derive posterior concentration rates for both grouped linear regression and sparse GAMs when the number of covariates grows at nearly exponential rate with sample size. Finally, we illustrate our methodology through extensive simulations and data analysis.Keywords
All Related Versions
Funding Information
- Foundation for the National Institutes of Health (1R01AI130460)
- Foundation for the National Institutes of Health (1R01LM012607)
This publication has 46 references indexed in Scilit:
- A Sparse-Group LassoJournal of Computational and Graphical Statistics, 2013
- A Selective Review of Group Selection in High-Dimensional ModelsStatistical Science, 2012
- clusterProfiler: an R Package for Comparing Biological Themes Among Gene ClustersOMICS: A Journal of Integrative Biology, 2012
- Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problemThe Annals of Statistics, 2010
- Sparse Additive ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2009
- Super LearnerStatistical Applications in Genetics and Molecular Biology, 2007
- On singular values of matrices with independent rowsBernoulli, 2006
- Regulation of gene expression in the mammalian eye and its relevance to eye diseaseProceedings of the National Academy of Sciences, 2006
- Homozygosity mapping with SNP arrays identifiesTRIM32, an E3 ubiquitin ligase, as a Bardet–Biedl syndrome gene (BBS11)Proceedings of the National Academy of Sciences, 2006
- Local Asymptotics for Regression Splines and Confidence RegionsThe Annals of Statistics, 1998