Consistent Group Identification and Variable Selection in Regression With Correlated Predictors
- 1 January 2013
- journal article
- research article
- Published by Taylor & Francis in Journal of Computational and Graphical Statistics
- Vol. 22 (2) , 319-340
Abstract
Statistical procedures for variable selection have become integral elements in any analysis. Successful procedures are characterized by high predictive accuracy, yielding interpretable models while retaining computational efficiency. Penalized methods that perform coefficient shrinkage have been shown to be successful in many cases. Models with correlated predictors are particularly challenging to tackle. We propose a penalization procedure that performs variable selection while clustering groups of predictors automatically. The oracle properties of this procedure, including consistency in group identification, are also studied. The proposed method compares favorably with existing selection approaches in both prediction accuracy and model discovery, while retaining its computational efficiency. Supplementary materials are available online.Keywords
This publication has 23 references indexed in Scilit:
- On the adaptive elastic-net with a diverging number of parametersThe Annals of Statistics, 2009
- A multivariate regression approach to association analysis of a quantitative trait networkBioinformatics, 2009
- Simultaneous Regression Shrinkage, Variable Selection, and Supervised Clustering of Predictors with OSCARBiometrics, 2008
- Unified LASSO Estimation by Least Squares ApproximationJournal of the American Statistical Association, 2007
- Adaptive Lasso for Cox's proportional hazards modelBiometrika, 2007
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Better Subset Regression Using the Nonnegative GarroteTechnometrics, 1995
- Instabilities of Regression Estimates Relating Air Pollution to MortalityTechnometrics, 1973
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970