Metric-based model selection for time-series forecasting
Authors:
- 25 June 2003
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Metric-based methods, which use unlabeled data to detect gross dif- ferences in behavior away from the training points, have recently been intro- duced for model selection, often yielding very significant improvements over alternatives (including cross-validation). We introduce extensions that take ad- vantage of the particular case of time-series data in which the task involves prediction with a horizon h. The ideas are (i) to use at t the h unlabeled exam- ples that precede t for model selection, and (ii) take advantage of the different error distributions of cross-validation and the metric methods. Experimental results establish the effectiveness of these extensions in the context of feature subset selection.Keywords
All Related Versions
This publication has 5 references indexed in Scilit:
- Metric-Based Methods for Adaptive Model Selection and RegularizationMachine Learning, 2002
- Guest Introduction: Special Issue on New Methods for Model Selection and Model CombinationMachine Learning, 2002
- The Econometrics of Financial Markets1997
- A Simple, Positive Semi-Definite, Heteroskedasticity and Autocorrelation Consistent Covariance MatrixEconometrica, 1987
- Stochastic Complexity and ModelingThe Annals of Statistics, 1986