Effects of Data Resampling on Predicting Customer Churn via a Comparative Tree-based Random Forest and XGBoost
Open Access
- 27 June 2024
- journal article
- research article
- Published by IntSys Research in Journal of Computing Theories and Applications
- Vol. 2 (1) , 86-101
Abstract
Customer attrition has become the focus of many businesses today – since the online market space has continued to proffer customers, various choices and alternatives to goods, services, and products for their monies. Businesses must seek to improve value, meet customers' teething demands/needs, enhance their strategies toward customer retention, and better monetize. The study compares the effects of data resampling schemes on predicting customer churn for both Random Forest (RF) and XGBoost ensembles. Data resampling schemes used include: (a) default mode, (b) random-under-sampling RUS, (c) synthetic minority oversampling technique (SMOTE), and (d) SMOTE-edited nearest neighbor (SMOTEEN). Both tree-based ensembles were constructed and trained to assess how well they performed with the chi-square feature selection mode. The result shows that RF achieved F1 0.9898, Accuracy 0.9973, Precision 0.9457, and Recall 0.9698 for the default, RUS, SMOTE, and SMOTEEN resampling, respectively. Xgboost outperformed Random Forest with F1 0.9945, Accuracy 0.9984, Precision 0.9616, and Recall 0.9890 for the default, RUS, SMOTE, and SMOTEEN, respectively. Studies support that the use of SMOTEEN resampling outperforms other schemes; while, it attributed XGBoost enhanced performance to hyper-parameter tuning of its decision trees. Retention strategies of recency-frequency-monetization were used and have been found to curb churn and improve monetization policies that will place business managers ahead of the curve of churning by customers.Keywords
This publication has 109 references indexed in Scilit:
- Adaptive data augmentation for mandarin automatic speech recognitionApplied Intelligence, 2024
- Neural Data Augmentation for Legal Overruling Task: Small Deep Learning Models vs. Large Language ModelsNeural Processing Letters, 2024
- Fraud detection with natural language processingMachine Learning, 2023
- A Credit Card Fraud Detection Model Using Machine Learning Methods with a Hybrid of Undersampling and Oversampling for Handling Imbalanced Datasets for High Scores2023
- The internet of medical things and artificial intelligence: trends, challenges, and opportunitiesBiocybernetics and Biomedical Engineering, 2022
- Data augmentation in natural language processing: a novel text generation approach for long and short text classifiersInternational Journal of Machine Learning and Cybernetics, 2022
- Habits and the electronic herd: The psychology behind social media’s successes and failuresConsumer Psychology Review, 2020
- A comparative analysis of gradient boosting algorithmsArtificial Intelligence Review, 2020
- Encyclopedia of Machine Learning and Data Science2020
- Smart Packaging: Consumer’s Perception and Diagnostic of Traceability Information2019