A word at a time
Open Access
- 28 March 2011
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 337-346
Abstract
Computing the degree of semantic relatedness of words is a key functionality of many language applications such as search, clustering, and disambiguation. Previous approaches to computing semantic relatedness mostly used static language resources, while essentially ignoring their temporal aspects. We believe that a considerable amount of relatedness information can also be found in studying patterns of word usage over time. Consider, for instance, a newspaper archive spanning many years. Two words such as "war" and "peace" might rarely co-occur in the same articles, yet their patterns of use over time might be similar. In this paper, we propose a new semantic relatedness model, Temporal Semantic Analysis (TSA), which captures this temporal information. The previous state of the art method, Explicit Semantic Analysis (ESA), represented word semantics as a vector of concepts. TSA uses a more refined representation, where each concept is no longer scalar, but is instead represented as time series over a corpus of temporally-ordered documents. To the best of our knowledge, this is the first attempt to incorporate temporal evidence into models of semantic relatedness. Empirical evaluation shows that TSA provides consistent improvements over the state of the art ESA results on multiple benchmarks.Keywords
This publication has 22 references indexed in Scilit:
- Wisdom of crowds versus wisdom of linguists – measuring the semantic relatedness of wordsNatural Language Engineering, 2009
- Recrawl scheduling based on information longevity2008
- Mining correlated bursty topic patterns from coordinated text streams2007
- Efficient search in large textual collections with redundancy2007
- Evaluating WordNet-based Measures of Lexical Semantic RelatednessComputational Linguistics, 2006
- Placing search in contextACM Transactions on Information Systems, 2002
- Measures of distributional similarity1999
- SEXTANT1992
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990
- On adaptive control processesIRE Transactions on Automatic Control, 1959