Asymptotically Honest Confidence Regions for High Dimensional Parameters by the Desparsified Conservative Lasso
Preprint
Abstract
In this paper we consider the conservative Lasso which we argue penalizes more correctly than the Lasso and show how it may be desparsified in the sense of van de Geer et al. (2014) in order to construct asymptotically honest (uniform) confidence bands. In particular, we develop an oracle inequality for the conservative Lasso only assuming the existence of a certain number of moments. This is done by means of the Marcinkiewicz-Zygmund inequality. We allow for heteroskedastic non-subgaussian error terms and covariates. Next, we desparsify the conservative Lasso estimator and derive the asymptotic distribution of tests involving an increasing number of parameters. Our simulations reveal that the desparsified conservative Lasso estimates the parameters more precisely than the desparsified Lasso, has better size properties and produces confidence bands with superior coverage rates.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Statistical learning and selective inferenceProceedings of the National Academy of Sciences, 2015
- Hypothesis Testing in High-Dimensional Regression Under the Gaussian Random Design Model: Asymptotic TheoryIEEE Transactions on Information Theory, 2014
- Inference on Treatment Effects after Selection among High-Dimensional ControlsReview of Economic Studies, 2013
- Confidence Intervals for Low Dimensional Parameters in High Dimensional Linear ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2013
- Tuning Parameter Selection in High Dimensional Penalized LikelihoodJournal of the Royal Statistical Society Series B: Statistical Methodology, 2012
- Regression Shrinkage and Selection via The Lasso: A RetrospectiveJournal of the Royal Statistical Society Series B: Statistical Methodology, 2011
- Sure Independence Screening for Ultrahigh Dimensional Feature SpaceJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- One-step sparse estimates in nonconcave penalized likelihood modelsThe Annals of Statistics, 2008
- High-dimensional graphs and variable selection with the LassoThe Annals of Statistics, 2006
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle PropertiesJournal of the American Statistical Association, 2001