Document Transformation for Multi-label Feature Selection in Text Categorization
Authors:
- Weizhu ChenWCWeizhu Chen
- Jun YanJYJun Yan
- Benyu ZhangBZBenyu Zhang
- Zheng ChenZCZheng Chen
- Qiang YangQYQiang Yang
- 1 October 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15504786,p. 451-456
Abstract
Feature selection on multi-label documents for automatic text categorization is an under-explored research area. This paper presents a systematic document transformation framework, whereby the multi-label documents are transformed into single-label documents before applying standard feature selection algorithms, to solve the multi-label feature selection problem. Under this framework, we undertake a comparative study on four intuitive document transformation approaches and propose a novel approach called entropy-based label assignment (ELA), which assigns the labels weights to a multi-label document based on label entropy. Three standard feature selection algorithms are utilized for evaluating the document transformation approaches in order to verify its impact on multi-class text categorization problems. Using a SVM classifier and two multi-label evaluation benchmark text collections, we show that the choice of document transformation approaches can significantly influence the performance of multi-class categorization and that our proposed document transformation approach ELA can achieve better performance than all other approaches.Keywords
This publication has 7 references indexed in Scilit:
- Multi-label informed latent semantic indexing2005
- OCFS2005
- An analysis of the relative hardness of Reuters‐21578 subsetsJournal of the American Society for Information Science and Technology, 2005
- Cost-sensitive learning by cost-proportionate example weighting2004
- A re-examination of text categorization methods1999
- Term-weighting approaches in automatic text retrievalInformation Processing & Management, 1988
- The maximum entropy principle in information retrieval1986