Robust Adaptive Lasso method for parameter’s estimation and variable selection in high-dimensional sparse models
Open Access
- 28 August 2017
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 12 (8) , e0183518
Abstract
High dimensional data are commonly encountered in various scientific fields and pose great challenges to modern statistical analysis. To address this issue different penalized regression procedures have been introduced in the litrature, but these methods cannot cope with the problem of outliers and leverage points in the heavy tailed high dimensional data. For this purppose, a new Robust Adaptive Lasso (RAL) method is proposed which is based on pearson residuals weighting scheme. The weight function determines the compatibility of each observations and downweight it if they are inconsistent with the assumed model. It is observed that RAL estimator can correctly select the covariates with non-zero coefficients and can estimate parameters, simultaneously, not only in the presence of influential observations, but also in the presence of high multicolliearity. We also discuss the model selection oracle property and the asymptotic normality of the RAL. Simulations findings and real data examples also demonstrate the better performance of the proposed penalized regression approach.Keywords
This publication has 30 references indexed in Scilit:
- Face recognition via Weighted Sparse RepresentationJournal of Visual Communication and Image Representation, 2013
- Correlation-Based Damage Detection for Complicated Truss Bridges Using Multi-Layer Genetic AlgorithmAdvances in Structural Engineering, 2012
- Penalized Composite Quasi-Likelihood for Ultrahigh Dimensional Variable SelectionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2011
- L1-Penalized Quantile Regression in High Dimensional Sparse ModelsSSRN Electronic Journal, 2009
- L1-Norm Quantile RegressionJournal of Computational and Graphical Statistics, 2008
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Weighted Likelihood Equations with Bootstrap Root SearchJournal of the American Statistical Association, 1998
- A one-step robust estimator for regression based on the weighted likelihood reweighting schemeStatistics & Probability Letters, 1998
- Minimum disparity estimation in the errors-in-variables modelStatistics & Probability Letters, 1994