Employee Turnover Prediction Model Based on Feature Selection and Imbalanced Data Handling
Open Access
- 15 July 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 126736-126755
Abstract
Employee turnover prediction is a critical task for organizations aiming to retain talent and reduce costs. In this study, we utilized the Kaggle HR dataset to predict employee turnover by employing a comprehensive machine learning pipeline. The dataset underwent rigorous preprocessing and exploratory data analysis (EDA) to identify key patterns and relationships. Feature selection was performed using correlation matrix analysis, Chi-Square tests, and Recursive Feature Elimination (RFE) to identify the most relevant features. To address the class imbalance issue, we applied both Synthetic Minority Over-sampling Technique (SMOTE) and Generative Adversarial Network (GAN-based) oversampling techniques. Eight models—Logistic Regression (LR), Naive Bayes (NB), Decision Tree (DT), Support Vector Machine (SVM), Random Forest (RF), Extreme Gradient Boosting (XGBoost), Deep Neural Network (DNN), and a hybrid model (RF + DNN) —were evaluated under different scenarios, including before and after feature selection and imbalance treatment. Model performance was assessed using recall, F1-score, Cohen’s Kappa, ROC-AUC, PR-AUC, and confusion matrix. To evaluate potential overfitting, we compared performance across training and validation sets. Model generalization was further validated using cross-validation techniques. Results showed that the RF model, trained on GAN-balanced data and using RFE-selected only five features, achieved the best performance with an accuracy of 0.98, precision of 0.98, recall of 0.92, F1-score of 0.95, and Cohen’s Kappa of 0.94. XGBoost model also showed outstanding performance, with evaluation metrics closely matching those of RF. To validate the robustness and generalizability of our approach, the same methodology was applied to an external dataset—the IBM HR dataset. The application of RFE and GAN-based oversampling significantly improved minority class detection in this independent dataset. Notably, XGBoost and the hybrid RF+DNN model performed best, further demonstrating the effectiveness and generalization of the proposed framework across different datasets.Keywords
Funding Information
- Humanity and Social Science Research Project of Anhui Educational Committee (2023AH052611)
This publication has 38 references indexed in Scilit:
- Predicting employee attrition and explaining its determinantsExpert Systems with Applications, 2025
- Data cleaning and machine learning: a systematic literature reviewAutomated Software Engineering, 2024
- A cluster-based human resources analytics for predicting employee turnover using optimized Artificial Neural Networks and data augmentationDecision Analytics Journal, 2024
- Information-Minimizing Generative Adversarial Network for Fair Generation and ClassificationNeural Processing Letters, 2024
- An ensemble learning model for predicting the intention to quit among employees using classification algorithmsDecision Analytics Journal, 2023
- A decade of research on machine learning techniques for predicting employee turnover: A systematic literature reviewExpert Systems with Applications, 2023
- Applied Statistical Learning2023
- Predictive model of employee attrition based on stacking ensemble learningExpert Systems with Applications, 2022
- Ensemble Feature Subset Selection: Integration of Symmetric Uncertainty and Chi-Square techniques with RReliefFJournal of The Institution of Engineers (India): Series B, 2022
- Binary Imbalanced Data Classification Based on Modified D2GAN Oversampling and Classifier FusionIEEE Access, 2020