Drawing Inferences for High-Dimensional Linear Models: A Selection-Assisted Partial Regression and Smoothing Approach
Authors:
- 14 December 2018
- journal article
- research article
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 75 (2) , 551-561
Abstract
Drawing inferences for high-dimensional models is challenging as regular asymptotic theories are not applicable. This article proposes a new framework of simultaneous estimation and inferences for high-dimensional linear models. By smoothing over partial regression estimates based on a given variable selection scheme, we reduce the problem to low-dimensional least squares estimations. The procedure, termed as Selection-assisted Partial Regression and Smoothing (SPARES), utilizes data splitting along with variable selection and partial regression. We show that the SPARES estimator is asymptotically unbiased and normal, and derive its variance via a nonparametric delta method. The utility of the procedure is evaluated under various simulation scenarios and via comparisons with the de-biased LASSO estimators, a major competitor. We apply the method to analyze two genomic datasets and obtain biologically meaningful results.Keywords
This publication has 30 references indexed in Scilit:
- Estimation and Accuracy After Model SelectionJournal of the American Statistical Association, 2014
- Genetic variation in RPS6KA1, RPS6KA2, RPS6KB1, RPS6KB2, and PDK1 and risk of colon or rectal cancerMutation Research - Fundamental and Molecular Mechanisms of Mutagenesis, 2011
- Sure independence screening in generalized linear models with NP-dimensionalityThe Annals of Statistics, 2010
- Overexpression of yes‐associated protein contributes to progression and poor prognosis of non‐small‐cell lung cancerCancer Science, 2010
- Nearly unbiased variable selection under minimax concave penaltyThe Annals of Statistics, 2010
- p-Values for High-Dimensional RegressionJournal of the American Statistical Association, 2009
- Sure Independence Screening for Ultrahigh Dimensional Feature SpaceJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006
- Developments in the use ofBacillusspecies for industrial productionCanadian Journal of Microbiology, 2004
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle PropertiesJournal of the American Statistical Association, 2001