Is Single Enough? A Joint Spatiotemporal Feature Learning Framework for Multivariate Time Series Prediction
- 3 November 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 35 (4) , 4985-4998
Abstract
A fuzzy cognitive map (FCM) is a simple but effective tool for modeling and predicting time series. This article focuses on the problem of multivariate time series prediction (TSP), which is essential and challenging in data mining. Although several FCM-based approaches have been designed to solve this problem, their feature extraction module designed for single mode falls short in capturing the nonlinear spatiotemporal dependencies among variates, thereby resulting in low prediction accuracy in forecasting multivariate time series, which shows that the single mode learning is not enough. Therefore, in this article, we propose a joint spatiotemporal feature learning framework for multivariate TSP, where a mix-resolution spatial module consisting of multiple sparse autoencoders (SAEs) is designed to extract the feature series with different spatial resolutions, and a mix-order spatiotemporal module concluding multiple high-order FCMs (HFCMs) is designed to model the spatiotemporal dynamics of these feature series. Finally, the outputs of the two modules are concatenated to predict future values. We refer to this framework as the spatiotemporal FCM (STFCM). Especially, an efficient learning algorithm is designed to update the integral weights of STFCM based on the batch gradient descent algorithm when it deems necessary. We validate the performance of the STFCM on four real-world datasets. Compared with the existing state-of-the-art (SOTA) methods, the experimental results not only show the advantages of the two designed modules in the STFCM but also show the excellent performance of the STFCM.Keywords
Funding Information
- Key Project of Science and Technology Innovation 2030 through the Ministry of Science and Technology of China (2018AAA0101302)
- National Natural Science Foundation of China (62206205)
- Zhejiang Laboratory’s International Talent Fund for Young Professionals
This publication has 50 references indexed in Scilit:
- Robust empirical wavelet fuzzy cognitive map for time series forecastingEngineering Applications of Artificial Intelligence, 2020
- A review on methods and software for fuzzy cognitive mapsArtificial Intelligence Review, 2017
- Fuzzy Cognitive Maps Employing ARIMA Components for Time Series Forecasting2017
- Time Series Analysis and Its Applications2017
- Application of evolutionary fuzzy cognitive maps to the long-term prediction of prostate cancerApplied Soft Computing, 2012
- The design of cognitive maps: A study in synergy of granular computing and evolutionary optimizationExpert Systems with Applications, 2010
- Comparing the inference capabilities of binary, trivalent and sigmoid fuzzy cognitive mapsInformation Sciences, 2008
- Genetic learning of fuzzy cognitive mapsFuzzy Sets and Systems, 2005
- Active Hebbian learning algorithm to train fuzzy cognitive mapsInternational Journal of Approximate Reasoning, 2004
- Small-Sample Forecasting Regression or Arima Models?Journal of Quantitative Economics, 2003