A fast and efficient smoothing approach to Lasso regression and an application in statistical genetics: polygenic risk scores for chronic obstructive pulmonary disease (COPD)
Authors:
- Georg HahnGHGeorg Hahn
- Sharon Marie LutzSLSharon Marie Lutz
- Nilanjana LahaNLNilanjana Laha
- Michael H. ChoMCMichael H. Cho
- Edwin K. SilvermanESEdwin K. Silverman
- Christoph LangeCLChristoph Lange
Preprint
Abstract
High dimensional linear regression problems are often fitted using Lasso approaches. Although the Lasso objective function is convex, it is not differentiable everywhere, making the use of gradient descent methods for minimization not straightforward. To avoid this technical issue, we apply Nesterov smoothing to the original (unsmoothed) Lasso objective function. We introduce a closed-form smoothed Lasso which preserves the convexity of the Lasso function, is uniformly close to the unsmoothed Lasso, and allows us to obtain closed-form derivatives everywhere for efficient and fast minimization via gradient descent. Our simulation studies are focused on polygenic risk scores using genetic data from a genome-wide association study (GWAS) for chronic obstructive pulmonary disease (COPD). We compare accuracy and run-time of our approach to the current gold standard in the literature, the FISTA algorithm. Our results suggest that the proposed methodology provides estimates with equal or higher accuracy than the FISTA algorithm while having the same asymptotic runtime scaling. The proposed methodology is implemented in the R-package smoothedLasso , available on the Comprehensive R Archive Network (CRAN).Keywords
All Related Versions
- Published version: Statistics and Computing, 31 (3), 1.
This publication has 10 references indexed in Scilit:
- fasta: Fast Adaptive Shrinkage/Thresholding Algorithm2018
- A Teaching Note for Model Selection and ValidationMATHEMATICAL JOURNAL OF INTERDISCIPLINARY SCIENCES, 2013
- Genetic Epidemiology of COPD (COPDGene) Study DesignCOPD: Journal of Chronic Obstructive Pulmonary Disease, 2010
- Genome-wide association analysis by lasso penalized logistic regressionBioinformatics, 2009
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- Smooth minimization of non-smooth functionsMathematical Programming, 2004
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraintCommunications on Pure and Applied Mathematics, 2004
- Least angle regressionThe Annals of Statistics, 2004
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle PropertiesJournal of the American Statistical Association, 2001
- Regression Shrinkage and Selection Via the LassoJournal of the Royal Statistical Society Series B: Statistical Methodology, 1996