Robust Variable Selection in High-dimensional Nonparametric Additive Model
Preprint
Abstract
Additive models belong to the class of structured nonparametric regression models that do not suffer from the curse of dimensionality. Finding the additive components that are nonzero when the true model is assumed to be sparse is an important problem, and it is well studied in the literature. The majority of the existing methods focused on using the $L_2$ loss function, which is sensitive to outliers in the data. We propose a new variable selection method for additive models that is robust to outliers in the data. The proposed method employs a nonconcave penalty for variable selection and considers the framework of B-splines and density power divergence loss function for estimation. The loss function produces an M-estimator that down weights the effect outliers. Our asymptotic results are derived under the sub-Weibull assumption, which allows the error distribution to have an exponentially heavy tail. Under regularity conditions, we show that the proposed method achieves the optimal convergence rate. In addition, our results include the convergence rates for sub-Gaussian and sub-Exponential distributions as special cases. We numerically validate our theoretical findings using simulations and real data analysis.
Keywords
All Related Versions
This publication has 58 references indexed in Scilit:
- Robust density power divergence estimates for panel data modelsAnnals of the Institute of Statistical Mathematics, 2023
- A robust spline approach in partially linear additive modelsComputational Statistics & Data Analysis, 2022
- Wavelet-based robust estimation and variable selection in nonparametric additive modelsStatistics and Computing, 2021
- Robust statistical inference based on the C-divergence familyAnnals of the Institute of Statistical Mathematics, 2018
- The Bennett-Orlicz NormSankhya A, 2017
- Marginal integration M-estimators for additive modelsTEST, 2016
- Additive model selectionStatistical Methods & Applications, 2016
- Sparse partial least-squares regression and its applications to high-throughput data analysisChemometrics and Intelligent Laboratory Systems, 2011
- Comments on «Wavelets in statistics: A review» by A. AntoniadisStatistical Methods & Applications, 1997
- Oncogenic regulation and function of keratins 8 and 18Cancer and Metastasis Reviews, 1996