To Combat Multiclass Imbalanced Problems by Aggregating Evolutionary Hierarchical Classifiers
- 8 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (3) , 5258-5272
Abstract
Real-world datasets are often imbalanced, posing frequent challenges to canonical machine learning algorithms that assume a balanced class distribution. Moreover, the imbalance problem becomes more complicated when the dataset is multiclass. Although many approaches have been presented for imbalanced learning (IL), research on the multiclass imbalanced problem is relatively limited and deficient. To alleviate these issues, we propose a forest of evolutionary hierarchical classifiers (FEHC) method for multiclass IL (MCIL). FEHC can be seen as a classifier fusion framework with a forest structure, and it aggregates several evolutionary hierarchical multiclassifiers (EHMCs) to reduce generalization error. Specifically, a multichromosome genetic algorithm (MCGA) is designed to simultaneously select (sub)optimal features, classifiers, and hierarchical structures when generating these EHMCs. The MCGA adopts a dynamic weighting module to learn difficult classes and promote the diversity of FEHC. We also present the “stratified underbagging” (SUB) strategy to address class imbalance and the “soft tree traversal” (STT) strategy to make FEHC converge faster and better. We thoroughly evaluate the proposed algorithm using 14 multiclass imbalanced datasets with various properties. Compared with popular and state-of-the-art approaches, FEHC obtains better performance under different evaluation metrics. Codes have been made publicly available on GitHub.https://github.com/CUHKSZ-NING/FEHCClassifierKeywords
Funding Information
- National Natural Science Foundation of China (NSFC) Fund (62202411)
- Shenzhen Science and Technology Program (ZDSYS20211021111415025)
- Shenzhen Institute of Artificial Intelligence and Robotics for Society
This publication has 62 references indexed in Scilit:
- Learning from class-imbalanced data: Review of methods and applicationsExpert Systems with Applications, 2017
- Multi-class and feature selection extensions of Roughly Balanced Bagging for imbalanced dataJournal of Intelligent Information Systems, 2017
- Hierarchical classification with reject option for live fish recognitionMachine Vision and Applications, 2014
- An instance level analysis of data complexityMachine Learning, 2013
- KEEL: a software tool to assess evolutionary algorithms for data mining problemsSoft Computing, 2008
- Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning2005
- SMOTEBoost: Improving Prediction of the Minority Class in Boosting2003
- Applied Logistic Regression2000
- Bagging predictorsMachine Learning, 1996
- A genetic algorithm tutorialStatistics and Computing, 1994