Detection boundary in sparse regression
Authors:
- Yuri I. IngsterYIYuri I. Ingster
- Alexandre B. TsybakovATAlexandre B. Tsybakov
- Nicolas VerzelenNVNicolas Verzelen
Open Access
- 1 January 2010
- journal article
- research article
- Published by Institute of Mathematical Statistics in Electronic Journal of Statistics
- Vol. 4 (none) , 1476-1526
Abstract
We study the problem of detection of a p-dimensional sparse vector of parameters in the linear regression model with Gaussian noise. We establish the detection boundary, i.e., the necessary and sufficient conditions for the possibility of successful detection as both the sample size n and the dimension p tend to infinity. Testing procedures that achieve this boundary are also exhibited. Our results encompass the high-dimensional setting (p≫n). The main message is that, under some conditions, the detection boundary phenomenon that has been previously established for the Gaussian sequence model, extends to high-dimensional linear regression. Finally, we establish the detection boundaries when the variance of the noise is unknown. Interestingly, the rate of the detection boundary in high-dimensional setting with unknown variance can be different from the rate for the case of known variance.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Minimax risks for sparse regressions: Ultra-high dimensional phenomenonsElectronic Journal of Statistics, 2012
- Innovated higher criticism for detecting sparse signals in correlated noiseThe Annals of Statistics, 2010
- Goodness-of-fit tests for high-dimensional Gaussian linear modelsThe Annals of Statistics, 2010
- Simultaneous analysis of Lasso and Dantzig selectorThe Annals of Statistics, 2009
- Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$-Constrained Quadratic Programming (Lasso)IEEE Transactions on Information Theory, 2009
- Higher criticism thresholding: Optimal feature selection when useful features are rare and weakProceedings of the National Academy of Sciences, 2008
- Estimation and confidence sets for sparse normal mixturesThe Annals of Statistics, 2007
- The Dantzig selector: Statistical estimation when p is much larger than nThe Annals of Statistics, 2007
- Goodness-of-fit tests via phi-divergencesThe Annals of Statistics, 2007
- Detecting a target in very noisy data from multiple looks2004