Local independence feature screening for nonparametric and semiparametric models by marginal empirical likelihood
Open Access
- 1 April 2016
- journal article
- research article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 44 (2) , 515-539
Abstract
We consider an independence feature screening technique for identifying explanatory variables that locally contribute to the response variable in high-dimensional regression analysis. Without requiring a specific parametric form of the underlying data model, our approach accommodates a wide spectrum of nonparametric and semiparametric model families. To detect the local contributions of explanatory variables, our approach constructs empirical likelihood locally in conjunction with marginal nonparametric regressions. Since our approach actually requires no estimation, it is advantageous in scenarios such as the single-index models where even specification and identification of a marginal model is an issue. By automatically incorporating the level of variation of the nonparametric regression and directly assessing the strength of data evidence supporting local contribution from each explanatory variable, our approach provides a unique perspective for solving feature screening problems. Theoretical analysis shows that our approach can handle data dimensionality growing exponentially with the sample size. With extensive theoretical illustrations and numerical examples, we show that the local independence screening approach performs promisingly.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Feature Screening via Distance Correlation LearningJournal of the American Statistical Association, 2012
- Model-Free Feature Screening for Ultrahigh-Dimensional DataJournal of the American Statistical Association, 2011
- Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Additive ModelsJournal of the American Statistical Association, 2011
- Penalized high-dimensional empirical likelihoodBiometrika, 2010
- Variable selection in nonparametric additive modelsThe Annals of Statistics, 2010
- Effects of data dimension on empirical likelihoodBiometrika, 2009
- Sure Independence Screening for Ultrahigh Dimensional Feature SpaceJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Quadratic Inference Functions for Varying‐Coefficient Models with Longitudinal DataBiometrics, 2005
- Varying-coefficient models and basis function approximations for the analysis of repeated measurementsBiometrika, 2002
- Two-step Estimation of Functional Linear Models with Applications to Longitudinal DataJournal of the Royal Statistical Society Series B: Statistical Methodology, 2000