Effective Document Labeling with Very Few Seed Words
Authors:
Open Access
- 24 October 2016
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 85-94
Abstract
Developing text classifiers often requires a large number of labeled documents as training examples. However, manually labeling documents is costly and time-consuming. Recently, a few methods have been proposed to label documents by using a small set of relevant keywords for each category, known as dataless text classification. In this paper, we propose a Seed-Guided Topic Model (named STM) for the dataless text classification task. Given a collection of unlabeled documents, and for each category a small set of seed words that are relevant to the semantic meaning of the category, the STM predicts the category labels of the documents through topic influence. STM models two kinds of topics: category-topics and general-topics. Each category-topic is associated with one specific category, representing its semantic meaning. The general-topics capture the global semantic information underlying the whole document collection. STM assumes that each document is associated with a single category-topic and a mixture of general-topics. A novelty of the model is that STM learns the topics by exploiting the explicit word co-occurrence patterns between the seed words and regular words (i.e., non-seed words) in the document collection. A document is then labeled, or classified, based on its posterior category-topic assignment. Experiments on two widely used datasets show that STM consistently outperforms the state-of-the-art dataless text classifiers. In some tasks, STM can also achieve comparable or even better classification accuracy than the state-of-the-art supervised learning solutions. Our experimental results further show that STM is insensitive to the tuning parameters. Stable performance with little variation can be achieved in a broad range of parameter settings, making it a desired choice for real applications.Keywords
Funding Information
- Natural Science Foundation of Hubei Province (2015CFB337)
- Ministry of Education - Singapore (MOE2014-T2-2-066)
- Natural Scientific Research Program of Wuhan University (2042015kf0014)
- National Natural Science Foundation of China (61502344)
This publication has 14 references indexed in Scilit:
- Topic Modeling for Short Texts with Auxiliary Word Embeddings2016
- Mining topics in documents2014
- Topic labeled text classification2014
- Document classification by topic labeling2013
- Improving text categorization bootstrapping via unsupervised learningACM Transactions on Speech and Language Processing, 2009
- Introduction to Information Retrieval2008
- Visualizing and Evaluating Complexity of Textual Case Bases2008
- Probabilistic latent semantic indexing1999
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990
- Estimation of statistical errors in molecular simulation calculationsMolecular Physics, 1986