Churn Prediction in Credit Customers Using Random Forest and XGBoost Methods
Open Access
- 31 March 2025
- journal article
- Published by Yocto Brain in Indonesian Journal of Data and Science
- Vol. 6 (1) , 82-90
Abstract
The increasing use of credit cards provides significant economic benefits to banks but also presents challenges in managing risks, one of which is customer churn. Churn occurs when customers stop using credit card services, potentially leading to financial losses and reduced revenue. This study aims to predict customer churn in credit card users using the Random Forest and XGBoost methods. The dataset comprises 5,000 customer records, with class imbalance consisting of 800 churn and 4,200 non-churn cases, addressed using the Synthetic Minority Over-sampling Technique (SMOTE). Analysis indicates that customers aged 40–55 dominate the churn group, with factors such as marital status, education level, transaction count, and total transaction value contributing to churn. Model evaluation shows that XGBoost achieves 96% accuracy with a precision of 86%, recall of 89%, and an F1-score of 87% for the minority class after tuning, although accuracy did not improve compared to pre-tuning. In contrast, Random Forest showed an increase in accuracy from 95% to 96% after tuning, with the F1-score for the minority class improving from 85% to 88%. Both models demonstrated excellent performance, but XGBoost excelled in identifying the minority class. Thus, XGBoost is recommended as the best model for churn prediction in this study.Keywords
This publication has 21 references indexed in Scilit:
- Improving Unbalanced Security X-Ray Image Classification Using VGG16 and AlexNet with Z-Score Normalization and Augmentation2024
- Enhancing Diabetic Retinopathy Image Classification using CNN, Resnet, and Googlenet Models with Z-Score Normalization and GLCM Feature Extraction2024
- Comparison of Z-score, min-max, and no normalization methods using support vector machine algorithm to predict student’s timely graduationAIP Conference Proceedings, 2024
- Progression of Pediatric Crohn’s Disease Is Associated With Anti–Tumor Necrosis Factor Timing and Body Mass Index Z-Score NormalizationClinical Gastroenterology and Hepatology, 2023
- Random forest-based modeling for insights on phosphorus content in hydrochar produced from hydrothermal carbonization of sewage sludgeEnergy, 2022
- Classification of Zambian grasslands using random forest feature importance selection during the optimal phenological periodEcological Indicators, 2022
- Improving the Prediction of Heart Failure Patients’ Survival Using SMOTE and Effective Data Mining TechniquesIEEE Access, 2021
- RFRSF: Employee Turnover Prediction Based on Random Forests and Survival Analysis2020
- Class-imbalanced dynamic financial distress prediction based on Adaboost-SVM ensemble combined with SMOTE and time weightingInformation Fusion, 2020
- An Efficient Architecture for Golay Code Encoder2018