Fast Candidate Points Selection in the LASSO Path
- 13 December 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 19 (2) , 79-82
Abstract
The LASSO sparse regression method has recently received attention in a variety of applications from image compression techniques to parameter estimation problems. This paper addresses the problem of regularization parameter selection in this method in a general case of complex-valued regressors and bases. Generally, this parameter controls the degree of sparsity or equivalently, the estimated model order. However, with the same sparsity/model order, the smallest regularization parameter is desired. We relate such points to the nonsmooth points in the path of LASSO solutions and give an analytical expression for them. Then, we introduce a numerically fast method of approximating the desired points by a recursive algorithm. The procedure decreases the necessary number of solutions of the LASSO problem dramatically, which is an important issue due to the polynomial computational cost of the convex optimization techniques. We illustrate our method in the context of DOA estimation.Keywords
This publication has 12 references indexed in Scilit:
- Regularization Paths for Cox's Proportional Hazards Model via Coordinate DescentJournal of Statistical Software, 2011
- Pathwise coordinate optimizationThe Annals of Applied Statistics, 2007
- High-dimensional graphs and variable selection with the LassoThe Annals of Statistics, 2006
- Model-order selectionIEEE Signal Processing Magazine, 2004
- Least angle regressionThe Annals of Statistics, 2004
- Convex Optimization2004
- Detection and estimation of superimposed signals2002
- On the application of the global matched filter to DOA estimation with uniform circular arraysIEEE Transactions on Signal Processing, 2001
- A new approach to variable selection in least squares problemsIMA Journal of Numerical Analysis, 2000
- Two decades of array signal processing research: the parametric approachIEEE Signal Processing Magazine, 1996