Statistical Inference and Large-scale Multiple Testing for High-dimensional Regression Models
Authors:
Preprint
Abstract
This paper presents a selective survey of recent developments in statistical inference and multiple testing for high-dimensional regression models, including linear and logistic regression. We examine the construction of confidence intervals and hypothesis tests for various low-dimensional objectives such as regression coefficients and linear and quadratic functionals. The key technique is to generate debiased and desparsified estimators for the targeted low-dimensional objectives and estimate their uncertainty. In addition to covering the motivations for and intuitions behind these statistical methods, we also discuss their optimality and adaptivity in the context of high-dimensional inference. In addition, we review the recent development of statistical inference based on multiple regression models and the advancement of large-scale multiple testing for high-dimensional regression. The R package SIHR has implemented some of the high-dimensional inference methods discussed in this paper.Keywords
All Related Versions
This publication has 98 references indexed in Scilit:
- Inference and uncertainty quantification for noisy matrix completionProceedings of the National Academy of Sciences, 2019
- Optimal Estimation of Genetic Relatedness in High-Dimensional Linear ModelsJournal of the American Statistical Association, 2018
- Testing endogeneity with high dimensional covariatesJournal of Econometrics, 2018
- Linear Hypothesis Testing in Dense High-Dimensional Linear ModelsJournal of the American Statistical Association, 2018
- High-dimensional simultaneous inference with the bootstrapTEST, 2017
- Multiple Testing of Submatrices of a Precision Matrix With Applications to Identification of Between Pathway InteractionsJournal of the American Statistical Association, 2017
- Data-driven hypothesis weighting increases detection power in genome-scale multiple testingNature Methods, 2016
- Robust inference on average treatment effects with possibly more covariates than observationsJournal of Econometrics, 2015
- Genome-wide Association Analysis for Multiple Continuous Secondary PhenotypesThe American Journal of Human Genetics, 2013
- Gene–environment interactions in human diseasesNature Reviews Genetics, 2005