Testing-Based Forward Model Selection
Author:
Preprint
Abstract
This paper introduces and analyzes a procedure called Testing-based forward model selection (TBFMS) in linear regression problems. This procedure inductively selects covariates that add predictive power into a working statistical model before estimating a final regression. The criterion for deciding which covariate to include next and when to stop including covariates is derived from a profile of traditional statistical hypothesis tests. This paper proves probabilistic bounds for prediction error and the number of selected covariates, which depend on the quality of the tests. The bounds are then specialized to a case with heteroskedastic data with tests derived from Huber-Eicker-White standard errors. TBFMS performance is compared to Lasso and Post-Lasso in simulation studies. TBFMS is then analyzed as a component into larger post-model selection estimation problems for structural economic parameters. Finally, TBFMS is used to illustrate an empirical application to estimating determinants of economic growth.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- Inference in High-Dimensional Panel Models With an Application to Gun ControlJournal of Business & Economic Statistics, 2016
- Community detection in sparse networks via Grothendieck’s inequalityProbability Theory and Related Fields, 2015
- Instrumental variables estimation with many weak instruments using regularized JIVEJournal of Econometrics, 2014
- ASYMPTOTIC DISTRIBUTION OF JIVE IN A HETEROSKEDASTIC IV REGRESSION WITH MANY INSTRUMENTSEconometric Theory, 2011
- Boosting diffusion indicesJournal of Applied Econometrics, 2009
- Forecasting economic time series using targeted predictorsJournal of Econometrics, 2008
- SHRINKAGE ESTIMATION FOR NEARLY SINGULAR DESIGNSEconometric Theory, 2007
- On sparse reconstruction from Fourier and Gaussian measurementsCommunications on Pure and Applied Mathematics, 2007
- Asymptotic efficiency in estimation with conditional moment restrictionsJournal of Econometrics, 1987
- The nonlinear two-stage least-squares estimatorJournal of Econometrics, 1974