A General Theory of Concave Regularization for High-Dimensional Sparse Estimation Problems
Authors:
- Cun-Hui ZhangCZCun-Hui Zhang
- Tong ZhangTZTong Zhang
Top Cited Papers
Open Access
- 1 November 2012
- journal article
- Published by Institute of Mathematical Statistics in Statistical Science
- Vol. 27 (4) , 576-593
Abstract
Concave regularization methods provide natural procedures for sparse recovery. However, they are difficult to analyze in the high-dimensional setting. Only recently a few sparse recovery results have been established for some specific local solutions obtained via specialized numerical procedures. Still, the fundamental relationship between these solutions such as whether they are identical or their relationship to the global minimizer of the underlying nonconvex formulation is unknown. The current paper fills this conceptual gap by presenting a general theoretical framework showing that, under appropriate conditions, the global solution of nonconvex regularization leads to desirable recovery performance; moreover, under suitable conditions, the global solution corresponds to the unique sparse local solution, which can be obtained via different numerical procedures. Under this unified framework, we present an overview of existing results and discuss their connections. The unified view of this work leads to a more satisfactory treatment of concave high-dimensional sparse estimation procedures, and serves as a guideline for developing further numerical procedures for concave regularization.Keywords
All Related Versions
This publication has 44 references indexed in Scilit:
- Square-root lasso: pivotal recovery of sparse signals via conic programmingBiometrika, 2011
- The Dantzig selector and sparsity oracle inequalitiesBernoulli, 2009
- Lasso-type recovery of sparse representations for high-dimensional dataThe Annals of Statistics, 2009
- The sparsity and bias of the Lasso selection in high-dimensional linear regressionThe Annals of Statistics, 2008
- One-step sparse estimates in nonconcave penalized likelihood modelsThe Annals of Statistics, 2008
- Sparsity oracle inequalities for the LassoElectronic Journal of Statistics, 2007
- On the LASSO and its DualJournal of Computational and Graphical Statistics, 2000
- A Statistical View of Some Chemometrics Regression ToolsTechnometrics, 1993
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- Some Comments on C
p
Technometrics, 1973