Sumblr
Authors:
Open Access
- 28 July 2013
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 533-542
Abstract
With the explosive growth of microblogging services, short-text messages (also known as tweets) are being created and shared at an unprecedented rate. Tweets in its raw form can be incredibly informative, but also overwhelming. For both end-users and data analysts it is a nightmare to plow through millions of tweets which contain enormous noises and redundancies. In this paper, we study continuous tweet summarization as a solution to address this problem. While traditional document summarization methods focus on static and small-scale data, we aim to deal with dynamic, quickly arriving, and large-scale tweet streams. We propose a novel prototype called Sumblr (SUMmarization By stream cLusteRing) for tweet streams. We first propose an online tweet stream clustering algorithm to cluster tweets and maintain distilled statistics called Tweet Cluster Vectors. Then we develop a TCV-Rank summarization technique for generating online summaries and historical summaries of arbitrary time durations. Finally, we describe a topic evolvement detection method, which consumes online and historical summaries to produce timelines automatically from tweet streams. Our experiments on large-scale real tweets demonstrate the efficiency and effectiveness of our approach.Keywords
This publication has 19 references indexed in Scilit:
- Generating event storylines from microblogs2012
- Discovering geographical topics in the twitter stream2012
- Evolutionary timeline summarization2011
- Twitinfo2011
- Text stream clustering algorithm based on adaptive feature selectionExpert Systems with Applications, 2011
- On clustering massive text and categorical data streamsKnowledge and Information Systems, 2009
- Bursty Feature Representation for Clustering Text Streams2007
- Efficient streaming text clusteringNeural Networks, 2005
- Centroid-based summarization of multiple documentsInformation Processing & Management, 2004
- Automatic evaluation of summaries using N-gram co-occurrence statistics2003