AirBERT: A fine-tuned language representation model for airlines tweet sentiment analysis
Authors:
- Anuradha YenkikarAYAnuradha Yenkikar
- C. Narendra BabuCBC. Narendra Babu
- 15 May 2023
- journal article
- research article
- Published by SAGE Publications in Intelligent Decision Technologies
- Vol. 17 (2) , 435-455
Abstract
Airlines operate in a competitive marketplace and must upgrade their services to meet customer safety and comfort. Post-pandemic, the government and airlines resumed flights with many restrictions, the impact which is unexplored. An increasing number of customers use social media to leave reviews and in this age of Machine Learning (ML), if a model is available to automatically polarize flyer sentiments, it can help airlines upscale. In this work, a custom dataset is scraped from Twitter by including online reviews of five Indian airlines. Multiclass sentiment analysis using three classifiers, support vector machine, K-nearest neighbor and random forest with word2vec and TF-IDF word embeddings is implemented. AirBERT, a fine-tuned deep learning attention model based on bidirectional encoder representation from transformers is proposed. From results, it is observed that on ML, Random Forest with TF-IDF performs the best but the graphical processing unit and domain corpora trained AirBERT outperforms all the other models with an accuracy of 91%. Indigo airlines and Jet Airways received the maximum percentage of positive and negative reviews respectively. In performance comparison with three existing models on the USA airlines tweets dataset, the proposed model outperforms others trained on general domain corpora and matches state-of-the-art TweetBERTv2 model accuracy. The model can be deployed by airlines and other service industries to implement a customer relationship management (CRM) system.Keywords
This publication has 24 references indexed in Scilit:
- Forest data visualization and land mapping using support vector machines and decision treesEarth Science Informatics, 2020
- Training feedforward neural network using genetic algorithm to diagnose left ventricular hypertrophyTELKOMNIKA (Telecommunication Computing Electronics and Control), 2020
- Performance Improvement of Naïve Bayes Classifier for Sentiment Estimation in Ambiguous Tweets of US Airlines2020
- Twitter Sentiment Analysis on Airline Tweets in India Using R LanguageJournal of Physics: Conference Series, 2020
- Tweets Classification on the Base of Sentiments for US Airline CompaniesEntropy, 2019
- A machine learning approach to analyze customer satisfaction from airline tweetsJournal of Big Data, 2019
- Airline Sentiment Visualization, Consumer Loyalty Measurement and Prediction using Twitter DataInternational Journal of Advanced Computer Science and Applications, 2018
- RETRACTED: Sentimental Analysis for Airline Twitter dataIOP Conference Series: Materials Science and Engineering, 2017
- An Ensemble Sentiment Classification System of Twitter Data for Airline Services Analysis2015
- An Empirical Analysis of Attitudinal and Behavioral Reactions Toward the Abandonment of Unprofitable Customer RelationshipsJournal of Relationship Marketing, 2010