A Deep Ensemble Learning Model for Prediction of Attrition – Effect of Unbalanced Dataset
Open Access
- 12 June 2026
- book chapter
- Published by Springer Nature
- p. 32-40
Abstract
Deep ensemble learning has become a very popular and efficient technique for making predictions. Traditional machine learning models are often not efficient when used for making predictions of imbalanced datasets. To counter the effects of imbalanced datasets, several different oversampling and synthetic sampling methods have been proposed. The effect of such sampling methods on deep ensemble learning methods is also not well studied. This study aims to explore two basic questions: whether deep ensemble models are suitable for unbalanced data given traditional methods are not and secondly if we use the oversampling method along with deep ensemble learning, does it improve model performance? For our comparison, we choose four models. We further scope this study by using only sequential ensemble models. We choose three baseline models and two deep-learning ensemble models for our study. We find that the deep ensemble learning models are better when we consider a combination of precision and recall. Also, oversampling significantly increases the model’s ability to correctly predict the underrepresented class.Keywords
This publication has 11 references indexed in Scilit:
- A Survey on ensemble learning under the era of deep learningArtificial Intelligence Review, 2022
- A Survey of Ensemble Learning: Concepts, Algorithms, Applications, and ProspectsIEEE Access, 2022
- Prediction of Employee Attrition Using Machine Learning and Ensemble MethodsInternational Journal of Machine Learning and Computing, 2021
- Random and Synthetic Over-Sampling Approach to Resolve Data Imbalance in ClassificationInternational Journal of Artificial Intelligence Research, 2021
- A Review of Dimensionality Reduction Techniques for Efficient ComputationProcedia Computer Science, 2019
- SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year AnniversaryJournal of Artificial Intelligence Research, 2018
- Efficient sampling techniques for ensemble learning and diagnosing bearing defects under class imbalanced condition2016
- XGBoost2016
- Distributional Random Oversampling for Imbalanced Text Classification2016
- Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble AccuracyMachine Learning, 2003