Globally adaptive quantile regression with ultra-high dimensional data
Open Access
- 1 October 2015
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 43 (5) , 2225-2258
Abstract
Quantile regression has become a valuable tool to analyze heterogeneous covaraite-response associations that are often encountered in practice. The development of quantile regression methodology for high-dimensional covariates primarily focuses on the examination of model sparsity at a single or multiple quantile levels, which are typically prespecified ad hoc by the users. The resulting models may be sensitive to the specific choices of the quantile levels, leading to difficulties in interpretation and erosion of confidence in the results. In this article, we propose a new penalization framework for quantile regression in the high-dimensional setting. We employ adaptive $L_{1}$ penalties, and more importantly, propose a uniform selector of the tuning parameter for a set of quantile levels to avoid some of the potential problems with model selection at individual quantile levels. Our proposed approach achieves consistent shrinkage of regression quantile estimates across a continuous range of quantiles levels, enhancing the flexibility and robustness of the existing penalized quantile regression methods. Our theoretical results include the oracle rate of uniform convergence and weak convergence of the parameter estimators. We also use numerical studies to confirm our theoretical findings and illustrate the practical utility of our proposal.
Keywords
All Related Versions
This publication has 34 references indexed in Scilit:
- Quantile Regression for Analyzing Heterogeneity in Ultra-High DimensionJournal of the American Statistical Association, 2012
- Censored quantile regression with partially functional effectsBiometrika, 2010
- Regularization Parameter Selections via Generalized Information CriterionJournal of the American Statistical Association, 2010
- Smoothly Clipped Absolute Deviation on High DimensionsJournal of the American Statistical Association, 2008
- The sparsity and bias of the Lasso selection in high-dimensional linear regressionThe Annals of Statistics, 2008
- Tuning parameter selectors for the smoothly clipped absolute deviation methodBiometrika, 2007
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006
- Regulation of gene expression in the mammalian eye and its relevance to eye diseaseProceedings of the National Academy of Sciences of the United States of America, 2006
- Algorithm AS 229: Computing Regression QuantilesJournal of the Royal Statistical Society Series C: Applied Statistics, 1987
- An Empirical Quantile Function for Linear Models with iid ErrorsJournal of the American Statistical Association, 1982