Integrating Transformer and GCN for COVID-19 Forecasting
Open Access
- 21 August 2022
- journal article
- research article
- Published by MDPI AG in Sustainability
- Vol. 14 (16) , 10393
Abstract
The spread of corona virus disease 2019 (COVID-19) has coincided with the rise of Transformer and graph neural networks, leading several studies to propose using them to better predict the evolution of a pandemic. The inconveniences of infectious diseases make it important to predict their spread. However, the single deep learning (DL) model has the problems of unstable prediction effect and poor convergence. When calculating the relationship between different positions within a sequence, Transformer does not consider the local context in which each position is located, which can make the prediction vulnerable to outliers, so the integration of the graph convolutional network (GCN) to capture local information is considered. In this paper, we use Transformer to encode the time sequence information of COVID-19 and GCN to decode the time sequence information with graph structure, so that Transformer and GCN are perfectly combined and spatial information is used to further study the integration of these two methods. In addition, we improve the traditional positional encoding structure and propose a dynamic positional encoding technique to extract dynamic temporal information effectively, which is proved to be the key to capture spatial and temporal patterns in data. To make our predictions more useful, we only focused on three states in the United States, covering one of the most affected states, one of the least affected states, and one intermediate state. We used mean absolute percentage error and mean square error as evaluation indexes. Experimental results show that the proposed time series model has better predictive performance than the current DL models. Moreover, the convergence of our model is also better than the current DL models, providing a more accurate reference for the prevention of epidemics.Keywords
Funding Information
- National Natural Science Foundation of school rank (KKZ1201907001)
This publication has 24 references indexed in Scilit:
- Time series forecasting of COVID-19 transmission in Canada using LSTM networksChaos, Solitons & Fractals, 2020
- A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: a study of a family clusterThe Lancet, 2020
- Why is it difficult to accurately predict the COVID-19 epidemic?Infectious Disease Modelling, 2020
- Real-Time Forecasting of Hand-Foot-and-Mouth Disease Outbreaks using the Integrating Compartment Model and Assimilation FilteringScientific Reports, 2019
- On the predictability of infectious disease outbreaksNature Communications, 2019
- Forecasting respiratory infectious outbreaks using ED-based syndromic surveillance for febrile ED visits in a Metropolitan CityThe American Journal of Emergency Medicine, 2019
- Predicting social response to infectious disease outbreaks from internet-based news streamsAnnals of Operations Research, 2017
- Mathematical models of SIR disease spread with combined non-sexual and sexual transmission routesInfectious Disease Modelling, 2017
- Deep Residual Learning for Image Recognition2016
- The effectiveness of fallowing strategies in disease control in salmon aquaculture assessed with an SIS modelPreventive Veterinary Medicine, 2011