A new dynamic classifier selection method for text classification
Open Access
- 26 July 2024
- journal article
- research article
- Published by The Scientific and Technological Research Council of Turkey (TUBITAK-ULAKBIM) - DIGITAL COMMONS JOURNALS in Turkish Journal of Electrical Engineering and Computer Sciences
- Vol. 32 (4) , 641-661
Abstract
The primary objective of employing multiple classifier systems (MCS) in pattern recognition is to enhance classification accuracy. Dynamic classifier selection (DCS) and dynamic ensemble selection (DES) are two purposeful forms of multiple classifier systems. While DES involves the selection of a classifier set followed by decision combination, DCS opts for the choice of a single competent classifier, eliminating the necessity for classifier combination. As a consequence, DCS methods exhibit superior efficiency in terms of processing time and memory usage compared to DES methods. Moreover, a substantial performance gap exists between the performance of Oracle and both DES and DCS methods. In this study, we introduce a novel method termed dynamic classifier selection technique-decision quotient (DCS-DQ) for text classification based on dynamic classifier selection. Our experimental investigation encompasses four distinct text datasets, with classification accuracy and macro F1-score serving as the primary evaluation criteria. The proposed DCS-DQ method is subjected to comparison with seven state-of-the-art DCS methods. Based on our empirical findings, the DCS-DQ method outperforms the other seven DCS methods in terms of classification accuracy across the majority of feature sizes. Notably, in the Reuters dataset, the classification accuracy of DCS-DQ surpasses that of other DCS methods for all feature sizes except when the feature size is 100. Similarly, in the Ohsumed dataset, the DCS-DQ method demonstrates significant performance improvement, with an accuracy value of 77.02% for 3000 features compared to the maximum accuracy value of 72.74% achieved by the DCS method MCB. Additionally, the performance of the proposed DCS-DQ method closely aligns with the oracle performance compared to the other methods. In conclusion, our proposed DCS-DQ method holds promise for significantly improving classification accuracy in text classification literature.Keywords
This publication has 48 references indexed in Scilit:
- Hybrid ensemble framework with self-attention mechanism for social spam detection on imbalanced dataExpert Systems with Applications, 2023
- A novel approach to define the local region of dynamic selection techniques in imbalanced credit scoring problemsExpert Systems with Applications, 2020
- An ensemble learning approach to lip-based biometric verification, with a dynamic selection of classifiersExpert Systems with Applications, 2019
- Dynamic weighted ensemble classification for credit scoring using Markov ChainApplied Intelligence, 2018
- Automatic categorization of Arabic articles based on their political orientationDigital Investigation, 2018
- Ensemble classification based on supervised clustering for credit scoringApplied Soft Computing, 2016
- Forest species recognition based on dynamic classifier selection and dissimilarity feature vector representationMachine Vision and Applications, 2015
- Accuracy–diversity based pruning of classifier ensemblesProgress in Artificial Intelligence, 2014
- Dynamic classifier ensemble model for customer classification with imbalanced class distributionExpert Systems with Applications, 2012
- Dynamic selection approaches for multiple classifier systemsNeural Computing and Applications, 2011