Hedging Forecast Combinations With an Application to the Random Forest
Preprint
Abstract
This papers proposes a generic, high-level methodology for generating forecast combinations that would deliver the optimal linearly combined forecast in terms of the mean-squared forecast error if one had access to two population quantities: the mean vector and the covariance matrix of the vector of individual forecast errors. We point out that this problem is identical to a mean-variance portfolio construction problem, in which portfolio weights correspond to forecast combination weights. We allow negative forecast weights and interpret such weights as hedging over and under estimation risks across estimators. This interpretation follows directly as an implication of the portfolio analogy. We demonstrate our method's improved out-of-sample performance relative to standard methods in combining tree forecasts to form weighted random forests in 14 data sets.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Forecast combinations: An over 50-year reviewInternational Journal of Forecasting, 2022
- PMLB v1.0: an open-source dataset collection for benchmarking machine learning methodsBioinformatics, 2021
- The Power of (Non-)Linear Shrinking: A Review and Guide to Covariance Matrix EstimationJournal of Financial Econometrics, 2020
- Optimal shrinkage estimator for high-dimensional mean vectorJournal of Multivariate Analysis, 2019
- A note on the validity of cross-validation for evaluating autoregressive time series predictionComputational Statistics & Data Analysis, 2018
- Large Dynamic Covariance MatricesJournal of Business & Economic Statistics, 2017
- The Risk of James–Stein and Lasso ShrinkageEconometric Reviews, 2015
- On the use of cross-validation for time series predictor evaluationInformation Sciences, 2012
- A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio NormsManagement Science, 2009
- Sample covariance shrinkage for high dimensional dependent dataJournal of Multivariate Analysis, 2008