Mining and Validating Social Media Data for COVID-19–Related Human Behaviors Between January and July 2020: Infodemiology Study
Authors:
- Ashlynn R DaughtonADAshlynn R Daughton
- Courtney D ShelleyCSCourtney D Shelley
- Martha BarnardMBMartha Barnard
- Dax GertsDGDax Gerts
- Chrysm Watson RossCRChrysm Watson Ross
- Isabel CrookerICIsabel Crooker
- Gopal NadigaGNGopal Nadiga
- Nilesh MukundanNMNilesh Mukundan
- Nidia Yadira Vaquera ChavezNCNidia Yadira Vaquera Chavez
- Nidhi ParikhNPNidhi Parikh
- Travis PittsTPTravis Pitts
- Geoffrey FairchildGFGeoffrey Fairchild
Open Access
- 25 May 2021
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23 (5) , e27059
Abstract
Background: Health authorities can minimize the impact of an emergent infectious disease outbreak through effective and timely risk communication, which can build trust and adherence to subsequent behavioral messaging. Monitoring the psychological impacts of an outbreak, as well as public adherence to such messaging, is also important for minimizing long-term effects of an outbreak. Objective: We used social media data from Twitter to identify human behaviors relevant to COVID-19 transmission, as well as the perceived impacts of COVID-19 on individuals, as a first step toward real-time monitoring of public perceptions to inform public health communications. Methods: We developed a coding schema for 6 categories and 11 subcategories, which included both a wide number of behaviors as well codes focused on the impacts of the pandemic (eg, economic and mental health impacts). We used this to develop training data and develop supervised learning classifiers for classes with sufficient labels. Classifiers that performed adequately were applied to our remaining corpus, and temporal and geospatial trends were assessed. We compared the classified patterns to ground truth mobility data and actual COVID-19 confirmed cases to assess the signal achieved here. Results: We applied our labeling schema to approximately 7200 tweets. The worst-performing classifiers had F1 scores of only 0.18 to 0.28 when trying to identify tweets about monitoring symptoms and testing. Classifiers about social distancing, however, were much stronger, with F1 scores of 0.64 to 0.66. We applied the social distancing classifiers to over 228 million tweets. We showed temporal patterns consistent with real-world events, and we showed correlations of up to –0.5 between social distancing signals on Twitter and ground truth mobility throughout the United States. Conclusions: Behaviors discussed on Twitter are exceptionally varied. Twitter can provide useful information for parameterizing models that incorporate human behavior, as well as for informing public health communication strategies by describing awareness of and compliance with suggested behaviors.Keywords
All Related Versions
This publication has 39 references indexed in Scilit:
- Accounting for behavioral responses during a flu epidemic using home television viewingBMC Infectious Diseases, 2015
- Psychological Language on Twitter Predicts County-Level Heart Disease MortalityPsychological Science, 2015
- From health search to healthcare: explorations of intention and utilization via query logs and user surveysJournal of the American Medical Informatics Association, 2014
- National and Local Influenza Surveillance through Twitter: An Analysis of the 2012-2013 Influenza EpidemicPLOS ONE, 2013
- Social media use by community-based organizations conducting health promotion: a content analysisBMC Public Health, 2013
- Assessing Vaccination Sentiments with Online Social Media: Implications for Infectious Disease Dynamics and ControlPLOS Computational Biology, 2011
- Using Web Search Query Data to Monitor Dengue Epidemics: A New Model for Neglected Tropical Disease SurveillancePLOS Neglected Tropical Diseases, 2011
- Tracking the Rise in Popularity of Electronic Nicotine Delivery Systems (Electronic Cigarettes) Using Search Query SurveillanceAmerican Journal of Preventive Medicine, 2011
- Low Acceptability of A/H1N1 Pandemic Vaccination in French Adult Population: Did Public Health Policy Fuel Public Dissonance?PLOS ONE, 2010
- Precautionary Behavior in Response to Perceived Threat of Pandemic InfluenzaEmerging Infectious Diseases, 2007