Spatio-Temporal Parallel Transformer Based Model for Traffic Prediction
Open Access
- 30 November 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Knowledge Discovery From Data
- Vol. 18 (9) , 1-25
Abstract
Traffic forecasting problems involve jointly modeling the non-linear spatio-temporal dependencies at different scales. While graph neural network models have been effectively used to capture the non-linear spatial dependencies, capturing the dynamic spatial dependencies between the locations remains a major challenge. The errors in capturing such dependencies propagate in modeling the temporal dependencies between the locations, thereby severely affecting the performance of long-term predictions. While transformer-based mechanisms have been recently proposed for capturing the dynamic spatial dependencies, these methods are susceptible to fluctuations in data brought on by unforeseen events like traffic congestion and accidents. To mitigate these issues we propose an improvised spatio-temporal parallel transformer (STPT) based model for traffic prediction that uses multiple adjacency graphs passed through a pair of coupled graph transformer-convolution network units, operating in parallel, to generate more noise-resilient embeddings. We conduct extensive experiments on 4 real-world traffic datasets and compare the performance of STPT with several state-of-the-art baselines, in terms of measures like RMSE, MAE, and MAPE. We find that using STPT improves the performance by around \(10-34\%\) as compared to the baselines. We also investigate the applicability of the model on other spatio-temporal data in other domains. We use a Covid-19 dataset to predict the number of future occurrences in different regions from a given set of historical occurrences. The results demonstrate the superiority of our model for such datasets.
Keywords
This publication has 29 references indexed in Scilit:
- Graph Multi-Head Convolution for Spatio-Temporal Attention in Origin Destination Tensor Prediction2022
- Flow Prediction in Spatio-Temporal Networks Based on Multitask Deep LearningIEEE Transactions on Knowledge and Data Engineering, 2019
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- LSTM network: a deep learning approach for short‐term traffic forecastIET Intelligent Transport Systems, 2017
- Fully convolutional networks for semantic segmentation2015
- Long short-term memory neural network for traffic speed prediction using remote microwave sensor dataTransportation Research Part C: Emerging Technologies, 2015
- New Bayesian combination method for short-term traffic flow forecastingTransportation Research Part C: Emerging Technologies, 2014
- Discovering spatio-temporal causal interactions in traffic data streams2011
- Advantages of Radial Basis Function Networks for Dynamic System DesignIEEE Transactions on Industrial Electronics, 2011
- Real-time road traffic prediction with spatio-temporal correlationsTransportation Research Part C: Emerging Technologies, 2011