Random Forests for Time Series
Preprint
Abstract
Random forests were introduced in 2001 by Breiman and have since become a popular learning algorithm, for both regression and classification. However, when dealing with time series, random forests do not integrate the time-dependent structure, implicitly supposing that the observations are independent. We propose some variants of the random forests designed for time series. The idea is to replace the standard bootstrap with a dependent bootstrap (i.e block bootstrap) to subsample time series during the tree construction phase to take time dependence into account. We then present two numerical experiments on electricity load forecasting. The first one, at a disaggregated level, is based on an application to load forecasting of a building and illustrate how the variants may perform. The second one is at a more aggregated level (French national forecasting) but focusing on atypical periods. For both, we explore a heuristic for the choice of the block size, the new parameter.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Random forests for time-dependent processesESAIM: Probability and Statistics, 2020
- Aggregation of Multi-Scale Experts for Bottom-Up Load ForecastingIEEE Transactions on Smart Grid, 2019
- Statistical learning for wind power: A modeling and stability study towards forecastingWind Energy, 2017
- The Building Data Genome Project: An open, public data set from non-residential building electrical metersEnergy Procedia, 2017
- Bagging exponential smoothing methods using STL decomposition and Box–Cox transformationInternational Journal of Forecasting, 2016
- Comparison of ARIMA and Random Forest time series models for prediction of avian influenza H5N1 outbreaksBMC Bioinformatics, 2014
- Real-time human pose recognition in parts from single depth imagesCommunications of the ACM, 2013
- Newer Classification and Regression Tree Techniques: Bagging and Random Forests for Ecological PredictionEcosystems, 2006
- Random Forest: A Classification and Regression Tool for Compound Classification and QSAR ModelingJournal of Chemical Information and Computer Sciences, 2003
- Bootstrap Methods: Another Look at the JackknifeThe Annals of Statistics, 1979