Dimensionality reduction for active learning with nearest neighbour classifier in text categorisation problems
Authors:
- Michael DavyMDMichael Davy
- Saturnino LuzSLSaturnino Luz
- 1 December 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 292-297
Abstract
Dimensionality reduction techniques are commonly used in text categorisation problems to improve training and classification efficiency as well as to avoid overfitting. The best performing dimensionality reduction techniques for text categorisation are supervised, hence utilise the label information of the training data. Active learning is used to reduce the number of labelled training examples for problems where obtaining label information is expensive. Since the vast majority of data supplied to active learning are unlabelled, supervised dimensionality reduction techniques cannot be readily employed. For this reason, active learning in text categorisation problems do not perform dimensionality reduction thereby restricting the choice of classifier. In this paper we investigate unsupervised dimensionality reduction techniques in active learning for text categorisation problems. Two unsupervised techniques are investigated, namely document frequency and principal components analysis. We empirically show increased performance of active learning, using a k-nearest neighbour classifier, when dimensionality reduction is applied using the unsupervised techniques.Keywords
This publication has 6 references indexed in Scilit:
- Active Learning with History-Based Query Selection for Text Categorisation2007
- Large-scale text categorization by batch mode active learning2006
- An analysis of the relative hardness of Reuters‐21578 subsetsJournal of the American Society for Information Science and Technology, 2005
- Machine learning in automated text categorizationACM Computing Surveys, 2002
- A re-examination of text categorization methods1999
- A Sequential Algorithm for Training Text Classifiers1994