Asymptotic properties of the residual bootstrap for Lasso estimators
- 9 July 2010
- journal article
- Published by American Mathematical Society (AMS) in Proceedings of the American Mathematical Society
- Vol. 138 (12) , 4497-4509
Abstract
In this article, we derive the asymptotic distribution of the bootstrapped Lasso estimator of the regression parameter in a multiple linear regression model. It is shown that under some mild regularity conditions on the design vectors and the regularization parameter, the bootstrap approximation converges weakly to a random measure. The convergence result rigorously establishes a previously known heuristic formula for the limit distribution of the bootstrapped Lasso estimator. It is also shown that when one or more components of the regression parameter vector are zero, the bootstrap may fail to be consistent.Keywords
This publication has 9 references indexed in Scilit:
- On the distribution of penalized maximum likelihood estimators: The LASSO, SCAD, and thresholdingJournal of Multivariate Analysis, 2009
- Sparse estimators and the oracle property, or the return of Hodges’ estimatorJournal of Econometrics, 2008
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006
- Measure Theory and Probability Theory2006
- Asymptotics for lasso-type estimatorsThe Annals of Statistics, 2000
- Weak Convergence and Empirical Processes1996
- Regression Shrinkage and Selection Via the LassoJournal of the Royal Statistical Society Series B: Statistical Methodology, 1996
- Cube Root AsymptoticsThe Annals of Statistics, 1990
- Bootstrapping Regression ModelsThe Annals of Statistics, 1981