Text Clustering via Term Semantic Units
Authors:
- 1 August 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 417-420
Abstract
How best to represent text data is an important problem in text mining tasks including information retrieval, clustering, classification and etc.. In this paper, we proposed a compact document representation with term semantic units which are identified from the implicit and explicit semantic information. Among it, the implicit semantic information is extracted from syntactic content via statistical methods such as latent semantic indexing and information bottleneck. The explicit semantic information is mined from the external semantic resource (Wikipedia). The proposed compact representation model can map a document collection in a low-dimension space (term semantic units which are much less than the number of all unique terms). Experimental results on real data sets have shown that the compact representation efficiently improve the performance of text clustering.Keywords
This publication has 7 references indexed in Scilit:
- Mining meaning from WikipediaInternational Journal of Human-Computer Studies, 2009
- Exploiting Wikipedia as external knowledge for document clustering2009
- Semantic Clustering for a Functional Text Classification TaskLecture Notes in Computer Science, 2009
- Learning to link with wikipedia2008
- Distributional clustering of English words1993
- Divergence measures based on the Shannon entropyIEEE Transactions on Information Theory, 1991
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990