Assessing the Stability of Tweet Corpora for Hurricane Events Over Time
Authors:
Open Access
- 19 July 2019
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 59-66
Abstract
When natural disasters occur, various organizations and agencies turn to social media to understand who needs help and how they have been affected. The purpose of this study is twofold: first, to evaluate whether hurricane-related tweets have some consistency over time, and second, whether Twitter-derived content is thematically similar to other private social media data. Through a unique method of using Twitter data gathered from six different hurricanes, alongside private data collected from qualitative interviews conducted in the immediate aftermath of Hurricane Harvey, we hypothesize that there is some level of stability across hurricane-related tweet content over time that could be used for better real-time processing of social media data during natural disasters. We use latent Dirichlet allocation (LDA) to derive topics, and, using Hellinger distance as a metric, find that there is a detectable connection among hurricane topics. By uncovering some persistent thematic areas and topics in disaster-related tweets, we hope these findings can help first responders and government agencies discover urgent content in tweets more quickly and reduce the amount of human intervention needed.Keywords
Funding Information
- National Science Foundation (1760453)
This publication has 8 references indexed in Scilit:
- Training an Emergency-Response Image Classifier on Signal Data2018
- A Text Mining Research Based on LDA Topic Modelling2016
- Modeling virtual organizations with Latent Dirichlet Allocation: A case for natural language processingNeural Networks, 2014
- AIDR2014
- Novel Situational Information in Mass Emergencies: What does Twitter Provide?Procedia Engineering, 2014
- Improving LDA topic models for microblogs via tweet pooling and automatic labeling2013
- Twitter communications in mass emergency2012
- Minimum Hellinger Distance Estimates for Parametric ModelsThe Annals of Statistics, 1977