Long-Term Prediction of Small Time-Series Data Using Generalized Distillation
Authors:
- 1 July 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
The recent increase of "big data" in our society has led to major impacts of machine learning and data mining technologies in various fields ranging from marketing to science. On the other hand, there still exist areas where only small-sized data are available for various reasons, for example, high data acquisition costs or the rarity of targets events. Machine learning tasks using such small data are usually difficult because of the lack of information available for training accurate prediction models. In particular, for long-term time-series prediction, the data size tends to be small because of the unavailability of the data between input and output times in training. Such limitations on the size of time-series data further make long-term prediction tasks quite difficult; in addition, the difficulty that the far future is more uncertain than the near future.In this paper, we propose a novel method for long-term prediction of small time-series data designed in the framework of generalized distillation. The key idea of the proposed method is to utilize the middle-time data between the input and output times as "privileged information," which is available only in the training phase and not in the test phase. We demonstrate the effectiveness of the proposed method on both synthetic data and real-world data. The experimental results show the proposed method performs well, particularly when the task is difficult and has high input dimensions.Keywords
This publication has 17 references indexed in Scilit:
- Long-term time series prediction using OP-ELMNeural Networks, 2014
- A survey of multi-view machine learningNeural Computing and Applications, 2013
- A new learning paradigm: Learning using privileged informationNeural Networks, 2009
- Long-term time series prediction with the NARX network: An empirical evaluationNeurocomputing, 2008
- Methodology for long-term prediction of time seriesNeurocomputing, 2007
- Time-series prediction using a local linear wavelet neural networkNeurocomputing, 2006
- Multistep-Ahead Time Series Prediction2006
- Support vector machine with adaptive parameters in financial time series forecastingIEEE Transactions on Neural Networks, 2003
- Regression and time series model selection in small samplesBiometrika, 1989
- Fitting autoregressive models for predictionAnnals of the Institute of Statistical Mathematics, 1969