Classifying High-Dimensional Text and Web Data Using Very Short Patterns
Authors:
- Hassan H. MalikHMHassan H. Malik
- John R. KenderJKJohn R. Kender
- 1 December 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15504786,p. 923-928
Abstract
In this paper, we propose the "democratic classifier", a simple pattern-based classification algorithm that uses very short patterns for classification, and does not rely on the minimum support threshold. Borrowing ideas from democracy, our training phase allows each training instance to vote for an equal number of candidate size-2 patterns. The training instances select patterns by effectively balancing between local, class, and global significance of patterns. The selected patterns are simultaneously added to the model for all applicable classes and a novel power law based weighing scheme adjusts their weights with respect of each class. Results of experiments performed on 121 common text and Web datasets show that our algorithm almost always outperforms state of the art classification algorithms, without any parameter tuning. On 100 real-life Web datasets, the average absolute classification accuracy improvement was as great as 9.4% over SVM, Harmony, C4.5 and KNN. Also, our algorithm ran about 3.5 times faster than the fastest existing pattern-based classification algorithm.Keywords
This publication has 9 references indexed in Scilit:
- Classifying High-Dimensional Text and Web Data Using Very Short Patterns2008
- Interestingness measures for data miningACM Computing Surveys, 2006
- On Mining Instance-Centric Classification RulesIEEE Transactions on Knowledge and Data Engineering, 2006
- Parameterized generation of labeled datasets for text categorization based on a hierarchical directory2004
- Text categorization with many redundant features2004
- Text document categorization by term association2003
- Selecting the right interestingness measure for association patterns2002
- Hierarchical classification of Web content2000
- Inductive learning algorithms and representations for text categorization1998