Inference in Linear Regression Models with Many Covariates and Heteroscedasticity
Authors:
- 8 June 2018
- journal article
- research article
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 113 (523) , 1350-1361
Abstract
The linear regression model is widely used in empirical work in economics, statistics, and many other disciplines. Researchers often include many covariates in their linear model specification in an attempt to control for confounders. We give inference methods that allow for many covariates and heteroscedasticity. Our results are obtained using high-dimensional approximations, where the number of included covariates is allowed to grow as fast as the sample size. We find that all of the usual versions of Eicker–White heteroscedasticity consistent standard error estimators for linear models are inconsistent under this asymptotics. We then propose a new heteroscedasticity consistent standard error formula that is fully automatic and robust to both (conditional) heteroscedasticity of unknown form and the inclusion of possibly many covariates. We apply our findings to three settings: parametric linear models with many covariates, linear panel models with many fixed effects, and semiparametric semi-linear models with many technical regressors. Simulation evidence consistent with our theoretical results is provided, and the proposed methods are also illustrated with an empirical application. Supplementary materials for this article are available online.Keywords
All Related Versions
Funding Information
- Directorate for Social, Behavioral and Economic Sciences (1459931, 1459967)
This publication has 39 references indexed in Scilit:
- Risk of Bayesian Inference in Misspecified Models, and the Sandwich Covariance MatrixEconometrica, 2013
- On some heteroskedasticity-robust estimators of variance–covariance matrix of the least-squares estimatorsJournal of Statistical Planning and Inference, 2002
- Using Heteroscedasticity Consistent Standard Errors in the Linear Regression ModelThe American Statistician, 2000
- Bootstrap and Wild Bootstrap for High Dimensional Linear ModelsThe Annals of Statistics, 1993
- Asymptotic theory and econometric practiceJournal of Applied Econometrics, 1988
- Heteroscedasticity-Robustness of Jackknife Variance Estimators in Linear ModelsThe Annals of Statistics, 1987
- Jackknife, Bootstrap and Other Resampling Methods in Regression AnalysisThe Annals of Statistics, 1986
- Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample propertiesJournal of Econometrics, 1985
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983
- A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for HeteroskedasticityEconometrica, 1980