Sharp Convergence Rates for Forward Regression in High-Dimensional Sparse Linear Models
Author:
Preprint
Abstract
Forward regression is a statistical model selection and estimation procedure which inductively selects covariates that add predictive power into a working statistical regression model. Once a model is selected, unknown regression parameters are estimated by least squares. This paper analyzes forward regression in high-dimensional sparse linear models. Probabilistic bounds for prediction error norm and number of selected covariates are proved. The analysis in this paper gives sharp rates and does not require beta-min or irrepresentability conditions.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Inference in High-Dimensional Panel Models With an Application to Gun ControlJournal of Business & Economic Statistics, 2016
- Community detection in sparse networks via Grothendieck’s inequalityProbability Theory and Related Fields, 2015
- Reconstruction From Anisotropic Random MeasurementsIEEE Transactions on Information Theory, 2013
- Adaptive Forward-Backward Greedy Algorithm for Learning Sparse RepresentationsIEEE Transactions on Information Theory, 2011
- Boosting diffusion indicesJournal of Applied Econometrics, 2009
- Forecasting economic time series using targeted predictorsJournal of Econometrics, 2008
- SHRINKAGE ESTIMATION FOR NEARLY SINGULAR DESIGNSEconometric Theory, 2007
- On sparse reconstruction from Fourier and Gaussian measurementsCommunications on Pure and Applied Mathematics, 2007
- On Early Stopping in Gradient Descent LearningConstructive Approximation, 2007
- Regression Shrinkage and Selection Via the LassoJournal of the Royal Statistical Society Series B: Statistical Methodology, 1996