Epitweetr: Early warning of public health threats using Twitter data
Open Access
- 29 September 2022
- journal article
- research article
- Published by European Centre for Disease Control and Prevention (ECDC) in Eurosurveillance
- Vol. 27 (39) , 2200177
Abstract
Background: The European Centre for Disease Prevention and Control (ECDC) systematically collates information from sources to rapidly detect early public health threats. The lack of a freely available, customisable and automated early warning tool using data from Twitter prompted the ECDC to develop epitweetr, which collects, geolocates and aggregates tweets generating signals and email alerts. Aim: This study aims to compare the performance of epitweetr to manually monitoring tweets for the purpose of early detecting public health threats. Methods: We calculated the general and specific positive predictive value (PPV) of signals generated by epitweetr between 19 October and 30 November 2020. Sensitivity, specificity, timeliness and accuracy and performance of tweet geolocation and signal detection algorithms obtained from epitweetr and the manual monitoring of 1,200 tweets were compared. Results: The epitweetr geolocation algorithm had an accuracy of 30.1% at national, and 25.9% at subnational levels. The signal detection algorithm had 3.0% general PPV and 74.6% specific PPV. Compared to manual monitoring, epitweetr had greater sensitivity (47.9% and 78.6%, respectively), and reduced PPV (97.9% and 74.6%, respectively). Median validation time difference between 16 common events detected by epitweetr and manual monitoring was -48.6 hours (IQR: −102.8 to −23.7). Conclusion: Epitweetr has shown sufficient performance as an early warning tool for public health threats using Twitter data. Since epitweetr is a free, open-source tool with configurable settings and a strong automated component, it is expected to increase in usability and usefulness to public health experts.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Real-time processing of social media with SENTINEL: A syndromic surveillance system incorporating deep learning for health classificationInformation Processing & Management, 2019
- Social Networks Applied to Zika and H1N1 Epidemics: A Systematic Review2018
- Social media posts and online search behaviour as early-warning system for MRSA outbreaksAntimicrobial Resistance & Infection Control, 2018
- Monitoring Count Time Series inR: Aberration Detection in Public Health SurveillanceJournal of Statistical Software, 2016
- Identifying Concept-drift in Twitter StreamsProcedia Computer Science, 2015
- Diagnostic methods I: sensitivity, specificity, and other measures of accuracyKidney International, 2009
- Comparing syndromic surveillance detection methods: EARS' versus a CUSUM‐based methodologyStatistics in Medicine, 2008
- What is epidemic intelligence, and how is it being improved in Europe?Eurosurveillance, 2006
- Initial evaluation of the early aberration reporting system--Florida.2005
- A Statistical Algorithm for the Early Detection of Outbreaks of Infectious DiseaseJournal of the Royal Statistical Society Series A: Statistics in Society, 1996