Clustering Documents with Active Learning Using Wikipedia
Authors:
- Anna HuangAHAnna Huang
- David MilneDMDavid Milne
- Eibe FrankEFEibe Frank
- Ian H. WittenIWIan H. Witten
- 1 December 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15504786,p. 839-844
Abstract
Wikipedia has been applied as a background knowledge base to various text mining problems, but very few attempts have been made to utilize it for document clustering. In this paper we propose to exploit the semantic knowledge in Wikipedia for clustering, enabling the automatic grouping of documents with similar themes. Although clustering is intrinsically unsupervised, recent research has shown that incorporating supervision improves clustering performance, even when limited supervision is provided. The approach presented in this paper applies supervision using active learning. We first utilize Wikipedia to create a concept-based representation of a text document, with each concept associated to a Wikipedia article. We then exploit the semantic relatedness between Wikipedia concepts to find pair-wise instance-level constraints for supervised clustering, guiding clustering towards the direction indicated by the constraints. We test our approach on three standard text document datasets. Empirical results show that our basic document representation strategy yields comparable performance to previous attempts; and adding constraints improves clustering performance further by up to 20%.Keywords
This publication has 10 references indexed in Scilit:
- Learning to link with wikipedia2008
- Linking Documents to Encyclopedic KnowledgeIEEE Intelligent Systems, 2008
- Enhancing text clustering by leveraging Wikipedia semantics2008
- A new unsupervised method for document clustering by using WordNet lexical and conceptual relationsInformation Retrieval Journal, 2007
- Improving Text Classification by Using Encyclopedia Knowledge2007
- Wikipedia-Based Kernels for Text Categorization2007
- Clustering short texts using wikipedia2007
- A probabilistic framework for semi-supervised clustering2004
- Ontologies improve text document clustering2004
- Active Semi-Supervision for Pairwise Constrained Clustering2004