Fused Mean-variance Filter for Feature Screening
Authors:
- Yan Xiao-DongYan Xiao-Dong
- Xie Jin-HanXJXie Jin-Han
- Ding Xian-WenDXDing Xian-Wen
- Wang Zhi-QiangWZWang Zhi-Qiang
- Tang Nian-ShengTang Nian-Sheng
Preprint
Abstract
This paper proposes a novel model-free screening procedure for ultrahigh dimensional data analysis. By utilizing slicing technique which has been successfully ap- plied to continuous variables, we construct a new index called the fused mean-variance for feature screening. This method has the following merits: (i) it is model-free, i.e., without specifying regression form of predictors and response variable; (ii) it can be used to analyze various types of variables including discrete, categorical and continuous vari- ables; (iii) it still works well even when the covariates/random errors are heavy-tailed or the predictors are strongly dependent. Under some regularity conditions, we establish the sure screening and rank consistency. Simulation studies are conducted to assess the performance of the proposed approach. A real data is used to illustrate the proposed method.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Model-Free Feature Screening for Ultrahigh Dimensional Discriminant AnalysisJournal of the American Statistical Association, 2015
- Feature Screening for Ultrahigh Dimensional Categorical Data With ApplicationsJournal of Business & Economic Statistics, 2014
- Fused Estimators of the Central Subspace in Sufficient Dimension ReductionJournal of the American Statistical Association, 2014
- A Model-Averaging Approach for High-Dimensional RegressionJournal of the American Statistical Association, 2014
- Feature Screening via Distance Correlation LearningJournal of the American Statistical Association, 2012
- Sure Independence Screening for Ultrahigh Dimensional Feature SpaceJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006
- Model Selection and Estimation in Regression with Grouped VariablesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle PropertiesJournal of the American Statistical Association, 2001
- Regression Shrinkage and Selection Via the LassoJournal of the Royal Statistical Society Series B: Statistical Methodology, 1996