TSDW: Two‐stage word sense disambiguation using Wikipedia
- 12 April 2013
- journal article
- research article
- Published by Wiley in Journal of the American Society for Information Science and Technology
- Vol. 64 (6) , 1203-1223
Abstract
The semantic knowledge of Wikipedia has proved to be useful for many tasks, for example, named entity disambiguation. Among these applications, the task of identifying the word sense based on Wikipedia is a crucial component because the output of this component is often used in subsequent tasks. In this article, we present a two‐stage framework (called TSDW) for word sense disambiguation using knowledge latent in Wikipedia. The disambiguation of a given phrase is applied through a two‐stage disambiguation process: (a) The first‐stage disambiguation explores the contextual semantic information, where the noisy information is pruned for better effectiveness and efficiency; and (b) the second‐stage disambiguation explores the disambiguated phrases of high confidence from the first stage to achieve better redisambiguation decisions for the phrases that are difficult to disambiguate in the first stage. Moreover, existing studies have addressed the disambiguation problem for English text only. Considering the popular usage of Wikipedia in different languages, we study the performance of TSDW and the existing state‐of‐the‐art approaches over both English and Traditional Chinese articles. The experimental results show that TSDW generalizes well to different semantic relatedness measures and text in different languages. More important, TSDW significantly outperforms the state‐of‐the‐art approaches with both better effectiveness and efficiency.Keywords
This publication has 24 references indexed in Scilit:
- Learning a concept‐based document similarity measureJournal of the American Society for Information Science and Technology, 2012
- Concept-based document classification using Wikipedia and value functionJournal of the American Society for Information Science and Technology, 2011
- A Generalized Method for Word Sense Disambiguation Based on Wikipedia2011
- The WEKA data mining softwareACM SIGKDD Explorations Newsletter, 2009
- Exploring Words with Semantic Correlations from Chinese Wikipedia2008
- Information quality work organization in wikipediaJournal of the American Society for Information Science and Technology, 2008
- Internet encyclopaedias go head to head2005
- Unsupervised large-vocabulary word sense disambiguation with graph-based algorithms for sequence data labeling2005
- Automatic acquisition of hyponyms from large text corpora1992
- Measures of the Amount of Ecologic Association Between SpeciesEcology, 1945