Methods for Managing Class Imbalance in Machine Learning Tasks
- 16 October 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Class imbalance is a prevalent challenge in machine learning, particularly in domains like credit risk assessment, fraud detection, and medical diagnosis, where the minority class often represents the critical cases of interest. Traditional machine learning models tend to be biased towards the majority class, leading to suboptimal performance in detecting minority class instances. This paper explores various strategies to mitigate the effects of class imbalance, including performance metric adjustments, resampling techniques such as oversampling, undersampling, and Synthetic Minority oversampling Technique (SMOTE), as well as algorithmic modifications. We propose different hybrid approaches that combines Random Forest with Laplace regularization and others to enhance the classification of minority classes in imbalanced datasets. Our approach is validated using a credit risk dataset, where the proposed method demonstrates significant improvements in recall and F1 scores compared to baseline models, suggesting its effectiveness in addressing class imbalance in critical applications.Keywords
This publication has 14 references indexed in Scilit:
- A review of ensemble learning and data augmentation models for class imbalanced problems: Combination, implementation and evaluationExpert Systems with Applications, 2023
- A broad review on class imbalance learning techniquesApplied Soft Computing, 2023
- RUE: A robust personalized cost assignment strategy for class imbalance cost-sensitive learningJournal of King Saud University Computer and Information Sciences, 2023
- Class-overlap undersampling based on Schur decomposition for Class-imbalance problemsExpert Systems with Applications, 2023
- An empirical study of dynamic selection and random under-sampling for the class imbalance problemExpert Systems with Applications, 2023
- SWSEL: Sliding Window-based Selective Ensemble Learning for class-imbalance problemsEngineering Applications of Artificial Intelligence, 2023
- Addressing the class imbalance problem in network intrusion detection systems using data resampling and deep learningThe Journal of Supercomputing, 2023
- The class imbalance problem in deep learningMachine Learning, 2022
- CHSMOTE: Convex hull-based synthetic minority oversampling technique for alleviating the class imbalance problemInformation Sciences, 2022
- Imbalanced data classification: Using transfer learning and active samplingEngineering Applications of Artificial Intelligence, 2022