Utilizing RoBERTa Model for Churn Prediction through Clustered Contextual Conversation Opinion Mining
Open Access
- 8 December 2023
- journal article
- research article
- Published by MECS Publisher in International Journal of Intelligent Systems and Applications
- Vol. 15 (6) , 1-8
Abstract
In computational study and automatic recognition of opinions in free texts, certain words in sentences are used to decide its sentiments. While analysing each customer’s opinion per time in churn management will be effective for personalised recommendations. Oftentimes, the opinion is not sufficient for contextualised content mining. While personalised recommendations are time consuming, it also does not provide complete picture of an overall sentiment in the business community of customers. To help businesses identify widespread issues affecting a large segment of their customers towards engendering patterns and trends of different customer churn behaviour, here, we developed a clustered contextualised conversation as opinions set for integration with Roberta Model. The developed churn behavioural opinion clusters disambiguated short messages while charactering contents collectively based on context beyond keyword-based sentiment matching for effective mining. Based on the predicted opinion threshold, customer churn category for group-based personalised decision support was generated, with matching concepts. The baseline RoBERTa model on the contextually clustered opinions, trained with a batch size of 16, a learning rate of 2e-5, over 8 epochs, using a maximum sequence length of 128 and standard hyperparameters, achieved an accuracy of 92%, Precision of 88%, Recall of 86% and F1 score of 84% over a test set of 30%.Keywords
This publication has 9 references indexed in Scilit:
- Utilizing RoBERTa Model for Churn Prediction through Clustered Contextual Conversation Opinion MiningInternational Journal of Intelligent Systems and Applications, 2023
- Aspect Extraction Approach for Sentiment Analysis Using KeywordsComputers, Materials & Continua, 2023
- Customer churn prediction system: a machine learning approachComputing, 2021
- A ML and NLP based Framework for Sentiment Analysis on BigdataInternational Journal of Innovative Technology and Exploring Engineering, 2020
- Cultivating loyal customers through online customer communities: A psychological contract perspectiveJournal of Business Research, 2019
- A Churn Prediction Model Using Random Forest: Analysis of Machine Learning Techniques for Churn Prediction and Factor Identification in Telecom SectorIEEE Access, 2019
- Exploring contextual factors from consumer reviews affecting movie sales: an opinion mining approachElectronic Commerce Research, 2019
- Customer churn prediction in telecommunication industry using data certaintyJournal of Business Research, 2019
- Opinion Mining Techniques on Social Media DataInternational Journal of Computer Applications, 2015