An efficient churn prediction model using gradient boosting machine and metaheuristic optimization
Open Access
- 2 September 2023
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-18
Abstract
Customer churn remains a critical challenge in telecommunications, necessitating effective churn prediction (CP) methodologies. This paper introduces the Enhanced Gradient Boosting Model (EGBM), which uses a Support Vector Machine with a Radial Basis Function kernel (SVMRBF) as a base learner and exponential loss function to enhance the learning process of the GBM. The novel base learner significantly improves the initial classification performance of the traditional GBM and achieves enhanced performance in CP-EGBM after multiple boosting stages by utilizing state-of-the-art decision tree learners. Further, a modified version of Particle Swarm Optimization (PSO) using the consumption operator of the Artificial Ecosystem Optimization (AEO) method to prevent premature convergence of the PSO in the local optima is developed to tune the hyper-parameters of the CP-EGBM effectively. Seven open-source CP datasets are used to evaluate the performance of the developed CP-EGBM model using several quantitative evaluation metrics. The results showed that the CP-EGBM is significantly better than GBM and SVM models. Results are statistically validated using the Friedman ranking test. The proposed CP-EGBM is also compared with recently reported models in the literature. Comparative analysis with state-of-the-art models showcases CP-EGBM's promising improvements, making it a robust and effective solution for churn prediction in the telecommunications industry.Keywords
Funding Information
- Linköping University
This publication has 41 references indexed in Scilit:
- Multi-Verse Optimizer: a nature-inspired algorithm for global optimizationNeural Computing and Applications, 2015
- A novel particle swarm optimization algorithm with Levy flightApplied Soft Computing, 2014
- Grey Wolf OptimizerAdvances in Engineering Software, 2014
- An effective hybrid learning system for telecommunication churn predictionExpert Systems with Applications, 2013
- Gradient boosting machines, a tutorialFrontiers in Neurorobotics, 2013
- Ensemble classification based on generalized additive modelsComputational Statistics & Data Analysis, 2010
- Ensembling neural networks: Many could be better than allArtificial Intelligence, 2002
- Greedy function approximation: A gradient boosting machine.The Annals of Statistics, 2001
- An overview of statistical learning theoryIEEE Transactions on Neural Networks, 1999
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997