Collecting event‐related tweets from twitter stream
- 2 December 2018
- journal article
- research article
- Published by Wiley in Journal of the Association for Information Science and Technology
- Vol. 70 (2) , 176-186
Abstract
Twitter provides a channel of collecting and publishing instant information on major events like natural disasters. However, information flow on Twitter is of great volume. For a specific event, messages collected from the Twitter Stream based on either location constraint or predefined keywords would contain a lot of noise. In this article, we propose a method to achieve both high‐precision and high‐recall in collecting event‐related tweets. Our method involves an automatic keyword generation component, and an event‐related tweet identification component. For keyword generation, we consider three properties of candidate keywords, namely relevance, coverage, and evolvement. The keyword updating mechanism enables our method to track the main topics of tweets along event development. To minimize annotation effort in identifying event‐related tweets, we adopt active learning and incorporate multiple‐instance learning which assigns labels to bags instead of instances (that is, individual tweets). Through experiments on two real‐world events, we demonstrate the superiority of our method against state‐of‐the‐art alternatives.Keywords
This publication has 24 references indexed in Scilit:
- HSpam142015
- Filtering big data from social media – Building an early warning system for adverse drug reactionsJournal of Biomedical Informatics, 2015
- Automatic Keyphrase Extraction: A Survey of the State of the Art2014
- Discovering coherent topics using general knowledge2013
- Event detection over twitter social media streamsThe VLDB Journal, 2013
- Identifying content for planned events across social media sites2012
- Emerging topic detection using dictionary learning2011
- Chi‐Square Distribution2005
- 10.1162/jmlr.2003.3.4-5.993Applied Physics Letters, 2000
- Heterogeneous Uncertainty Sampling for Supervised Learning1994