Lasso Meets Horseshoe: A Survey
Authors:
- Anindya BhadraABAnindya Bhadra
- Jyotishka DattaJDJyotishka Datta
- Nicholas G. PolsonNPNicholas G. Polson
- Brandon WillardBWBrandon Willard
Top Cited Papers
- 1 August 2019
- journal article
- research article
- Published by Institute of Mathematical Statistics in Statistical Science
- Vol. 34 (3) , 405-427
Abstract
The goal of this paper is to contrast and survey the major advances in two of the most commonly used high-dimensional techniques, namely, the Lasso and horseshoe regularization. Lasso is a gold standard for predictor selection while horseshoe is a state-of-the-art Bayesian estimator for sparse signals. Lasso is fast and scalable and uses convex optimization whilst the horseshoe is nonconvex. Our novel perspective focuses on three aspects: (i) theoretical optimality in high-dimensional inference for the Gaussian sparse model and beyond, (ii) efficiency and scalability of computation and (iii) methodological development and performance.Keywords
All Related Versions
This publication has 88 references indexed in Scilit:
- Understanding predictive information criteria for Bayesian modelsStatistics and Computing, 2013
- On the Half-Cauchy Prior for a Global Scale ParameterBayesian Analysis, 2012
- Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequencesThe Annals of Statistics, 2012
- Square-root lasso: pivotal recovery of sparse signals via conic programmingBiometrika, 2011
- A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysisBiostatistics, 2009
- Sparse inverse covariance estimation with the graphical lassoBiostatistics, 2007
- The Variable Selection ProblemJournal of the American Statistical Association, 2000
- Adapting to Unknown Smoothness via Wavelet ShrinkageJournal of the American Statistical Association, 1995
- Bayesian Variable Selection in Linear RegressionJournal of the American Statistical Association, 1988
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970