Conditional variable screening via ordinary least squares projection
Preprint
Abstract
In this article, we propose a novel variable screening method for linear models named as conditional screening via ordinary least squares projection (COLP). COLP can take advantage of prior knowledge concerning certain active predictors by eliminating the adverse impact of their coefficients in the estimation of remaining ones and thus significantly enhance the screening accuracy. We prove its sure-screening property under reasonable assumptions and demonstrate its utility in an application to a leukemia dataset. Moreover, based on the conditional approach, we introduce an iterative algorithm named as forward screening via ordinary least squares projection (FOLP), which not only could exploit the prior information more effectively, but also has promising performance when no prior knowledge is available using a data-driven conditioning set. Extensive simulation studies are carried out to demonstrate the competence of both proposed methods.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Conditional Sure Independence ScreeningJournal of the American Statistical Association, 2016
- Feature Screening via Distance Correlation LearningJournal of the American Statistical Association, 2012
- Introduction to the non-asymptotic analysis of random matrices2012
- Nonconcave Penalized Likelihood With NP-DimensionalityIEEE Transactions on Information Theory, 2011
- Projection Matrices, Generalized Inverse Matrices, and Singular Value Decomposition2011
- Extended Bayesian information criteria for model selection with large model spacesBiometrika, 2008
- Prognostic significance of myeloperoxidase expression in childhood acute myeloid leukemiaPediatric Blood & Cancer, 2008
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- The percentage of myeloperoxidase-positive blast cells is a strong independent prognostic factor in acute myeloid leukemia, even in the patients with normal karyotypeLeukemia, 2003
- Diagnosis of multiple cancer types by shrunken centroids of gene expressionProceedings of the National Academy of Sciences, 2002