GTformer: Graph-Based Temporal-Order-Aware Transformer for Long-Term Series Forecasting
- 27 June 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (19) , 31467-31478
Abstract
In the production environment of the Internet of Things (IoT), sensors of various qualities generate a large amount of multivariate time series (MTS) data. The long-term prediction of time series data generated by various IoT devices provides longer foresight and help execute necessary resource scheduling or fault alarms in advance, thus improving the efficiency of system operation and ensuring system security. In recent years, deep learning models like Transformers have achieved advanced performance in multivariate long-term time series forecasting (MLTSF) tasks. However, many previous research attempts either overlook the inter-series dependencies or ignore to model strict temporal order of MTS data. In this paper, we introduce GT-former, a graph-based temporal-order-aware transformer model. We propose an adaptive graph learning method specifically designed for MTS data to capture both uni-directional and bi-directional relations. In addition, we generate positional encoding in a sequential way to emphasize the strict temporal order of time series. By adopting these two components, our model can have a better understanding of the inter-series and intra-series dependencies of MTS data. We conduct extensive experiments on eight real-world datasets and the results show that our model achieves better predictions compared with state-of-the-art methods.Keywords
Funding Information
- National Natural Science Foundation of China (62272052, 62172051)
This publication has 32 references indexed in Scilit:
- Dynamic spatiotemporal interactive graph neural network for multivariate time series forecastingKnowledge-Based Systems, 2023
- DFNet: Decomposition fusion model for long sequence time-series forecastingKnowledge-Based Systems, 2023
- Muformer: A long sequence time-series forecasting model based on modified multi-head attentionKnowledge-Based Systems, 2022
- Multivariate time series forecasting method based on nonlinear spiking neural P systems and non-subsampled shearlet transformNeural Networks, 2022
- Solar forecasting with hourly updated numerical weather predictionRenewable and Sustainable Energy Reviews, 2022
- Financial time series forecasting with deep learning : A systematic literature review: 2005–2019Applied Soft Computing, 2020
- A Novel Intelligent Medical Decision Support Model Based on Soft Computing and IoTIEEE Internet of Things Journal, 2019
- Internet of Things (IoT) Cybersecurity Research: A Review of Current Research TopicsIEEE Internet of Things Journal, 2018
- A novel transfer learning framework for time series forecastingKnowledge-Based Systems, 2018
- A Data Mining Approach Combining $K$ -Means Clustering With Bagging Neural Network for Short-Term Wind Power ForecastingIEEE Internet of Things Journal, 2017