Real-time detection of twitter social events from the user's perspective
Authors:
- 1 June 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15503607,p. 1207-1212
Abstract
Over the last 40 years, automatic solutions to analyze text documents collection have been one of the most attractive challenges in the field of information retrieval. More recently, the focus has moved towards dynamic, distributed environments, where documents are continuously created by the users of a virtual community, i.e., the social network. In the case of Twitter, such documents, called tweets, are usually related to events which involve many people in different parts of the world. In this work we present a system for real-time Twitter data analysis which allows to follow a generic event from the user's point of view. The topic detection algorithm we propose is an improved version of the Soft Frequent Pattern Mining algorithm, designed to deal with dynamic environments. In particular, in order to obtain prompt results, the whole Twitter stream is split in dynamic windows whose size depends both on the volume of tweets and time. Moreover, the set of terms we use to query Twitter is progressively refined to include new relevant keywords which point out the emergence of new subtopics or new trends in the main topic. Tests have been performed to evaluate the performance of the framework and experimental results show the effectiveness of our solution.Keywords
This publication has 17 references indexed in Scilit:
- TopicSketch: Real-Time Bursty Topic Detection from Twitter2013
- Sequential Summarization: A Full View of Twitter Trending TopicsIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2013
- Mimicking biological mechanisms for sensory information fusionBiologically Inspired Cognitive Architectures, 2013
- Tweet Analysis for Real-Time Event Detection and Earthquake Reporting System DevelopmentIEEE Transactions on Knowledge and Data Engineering, 2012
- Summarizing sporting events using twitter2012
- Breaking News Detection and Tracking in Twitter2010
- Emerging topic detection on Twitter based on temporal and social terms evaluation2010
- Earthquake shakes Twitter users2010
- Incorporating non-local information into information extraction systems by Gibbs sampling2005
- The influence of the sigmoid function parameters on the speed of backpropagation learning1995