Inferring the origin locations of tweets with quantitative confidence
Open Access
- 15 February 2014
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1523-1536
Abstract
Social Internet content plays an increasingly critical role in many domains, including public health, disaster management, and politics. However, its utility is limited by missing geographic information; for example, fewer than 1.6% of Twitter messages (tweets) contain a geotag. We propose a scalable, content-based approach to estimate the location of tweets using a novel yet simple variant of gaussian mixture models. Further, because real-world applications depend on quantified uncertainty for such estimates, we propose novel metrics of accuracy, precision, and calibration, and we evaluate our approach accordingly. Experiments on 13 million global, comprehensively multi-lingual tweets show that our approach yields reliable, well-calibrated results competitive with previous computationally intensive methods. We also show that a relatively small number of training data are required for good estimates (roughly 30,000 tweets) and models are quite time-invariant (effective on tweets many weeks newer than the training set). Finally, we show that toponyms and languages with small geographic footprint provide the most useful location signals.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Modeling locations with social mediaInformation Retrieval Journal, 2012
- Inferring the Location of Twitter Messages Based on User RelationshipsTransactions in GIS, 2011
- Geo‐parsing Messages from MicrotextTransactions in GIS, 2011
- Twitter as medium and messageCommunications of the ACM, 2011
- Understanding individual human mobility patternsNature, 2008
- Mining geographic knowledge using location aware topic model2007
- Confidence Intervals for a binomial proportion and asymptotic expansionsThe Annals of Statistics, 2002
- An Examination of Procedures for Determining the Number of Clusters in a Data SetPsychometrika, 1985
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974