Interim evaluation of Google AI forecasting for COVID-19 compared with statistical forecasting by human intelligence in the first week
Preprint
Abstract
Background: Since June, Google (Alphabet Inc.) has provided forecasting for COVID-19 outbreak by artificial intelligence (AI) in the USA. In Japan, they provided similar services from November, 2020. Object: We compared Google AI forecasting with a statistical model by human intelligence. Method: We regressed the number of patients whose onset date was day t on the number of patients whose past onset date was 14 days prior, with information about traditional surveillance data for common pediatric infectious diseases including influenza, and prescription surveillance 7 days prior. We predicted the number of onset patients for 7 days, prospectively. Finally, we compared the result with Googles AI-produced forecast. We used the discrepancy rate to evaluate the precision of prediction: the sum of absolute differences between data and prediction divided by the aggregate of data. Results: We found Google prediction significantly negative correlated with the actual observed data, but our model slightly correlated but not significant. Moreover, discrepancy rate of Google prediction was 27.7% for the first week. The discrepancy rate of our model was only 3.47%. Discussion and Conclusion: Results show Googles prediction has negatively correlated and greater difference with the data than our results. Nevertheless, it is noteworthy that this result is tentative: the epidemic curve showing newly onset patients was not fixed.Keywords
This publication has 5 references indexed in Scilit:
- Mobility data can explain the entire COVID-19 outbreak course in JapanmedRxiv, 2020
- Prescription surveillance for early detection system of emerging and reemerging infectious disease outbreaksBioScience Trends, 2018
- Evaluation of the global action plan on antimicrobial resistance in Japan during its first eighteen monthsDrug Discoveries & Therapeutics, 2018
- Real-time Prescription Surveillance and its Application to Monitoring Seasonal Influenza Activity in JapanJournal of Medical Internet Research, 2012
- Annual Incidence Rate of Infectious Diseases Estimated from Sentinel Surveillance Data in Japan.Journal of Epidemiology, 2007