Unified reciprocal LASSO estimation via least squares approximation
- 21 November 2022
- journal article
- research article
- Published by Taylor & Francis in Communications in Statistics - Simulation and Computation
- Vol. 53 (9) , 4352-4362
Abstract
The primary goal of this article is to extend the reciprocal LASSO for applications to binary and survival outcomes. We consider the least squares approximation (LSA) as a solver for the reciprocal LASSO problem. The LSA is a general theoretical framework that includes generalized linear models, Cox regression, and many others as special cases. By applying LSA to reciprocal LASSO regularization, we transfer the original reciprocal LASSO problem into an asymptotically equivalent least squares problem. While the existing literature on reciprocal LASSO has mostly focused on linear models, our algorithm can be easily implemented for general likelihoods, providing a flexible framework for variable selection using reciprocal penalties. To handle the computational burden of implementing the resulting procedure, we employ a scalable stochastic search method called Simplified Shotgun Stochastic Search with Screening (S5), which is easy to implement, without requiring any sophisticated optimization package other than a linear equation solver. We examine the effectiveness of our procedure through Monte Carlo simulations and real data analyses.Keywords
This publication has 18 references indexed in Scilit:
- Scalable Bayesian Variable Selection Using Nonlocal Prior Densities in Ultrahigh-dimensional SettingsStatistica Sinica, 2018
- Bayesian variable selection for binary outcomes in high-dimensional genomic studies using non-local priorsBioinformatics, 2016
- High-Dimensional Variable Selection With Reciprocal L1-RegularizationJournal of the American Statistical Association, 2015
- Variable selection approach for zero-inflated count data via adaptive lassoJournal of Applied Statistics, 2013
- Bayesian adaptive LassoAnnals of the Institute of Statistical Mathematics, 2013
- Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selectionThe Annals of Applied Statistics, 2011
- On the C‐statistics for evaluating overall adequacy of risk prediction procedures with censored survival dataStatistics in Medicine, 2011
- Unified LASSO Estimation by Least Squares ApproximationJournal of the American Statistical Association, 2007
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle PropertiesJournal of the American Statistical Association, 2001