Arabic Short‐Text Dataset for Sentiment Analysis of Tourism and Leisure Events
Open Access
- 22 March 2025
- journal article
- Published by Wiley in Expert Systems
- Vol. 42 (5)
Abstract
The focus of this study is to present the detailed process of collecting a dataset of Arabic short‐text in the tourism context and annotating this dataset for the task of sentiment analysis using an automatic zero‐shot labelling technique utilising transformer‐based models. This is benchmarked against a baseline manual annotation approach utilising native Arab human annotators. This study also introduces an approach exploiting both manual/handcrafted and automatically generated annotations of the dataset tweets for the task of sentiment analysis as part of a cross‐domain approach using a model trained on sarcasm labels and vice versa. The total collected corpus size is 2293 tweets; after annotation, these tweets were labelled in a three‐way classification approach as either positive, negative or neutral. We run different experiments to provide benchmark results of Arabic sentiment classification. Comparative results on our dataset show that the highest performing baseline model when utilising manual labels was MARBERT, with an accuracy of up to 87%, which was pre‐trained for Arabic on a massive amount of data. It should be noted that this model enhanced its performance additionally after pre‐training on a dialectical Arabic and modern standard Arabic corpus. On the other hand, zero‐shot automatically generated labels achieved an 84% accuracy rate in predicting sarcasm classes from sentiment labels.Keywords
Funding Information
- Engineering and Physical Sciences Research Council (EP/M026981/1, EP/T021063/1, EP/T024917/1)
This publication has 27 references indexed in Scilit:
- Semantic Contrastive Embedding for Generalized Zero-Shot LearningInternational Journal of Computer Vision, 2022
- Zero-shot learning and its applications from autonomous vehicles to COVID-19 diagnosis: A reviewIntelligence-Based Medicine, 2020
- A review of sentiment analysis research in Arabic languageFuture Generation Computer Systems, 2020
- Weakly Supervised Framework for Aspect-Based Sentiment Analysis on Students’ Reviews of MOOCsIEEE Access, 2020
- Sentiment analyses of multilingual tweets on halal tourismTourism Management Perspectives, 2020
- Analyzing the impact of user-generated content on B2B Firms' stock performance: Big data analysis with machine learning methodsIndustrial Marketing Management, 2020
- Arabic sentiment analysis: studies, resources, and toolsSocial Network Analysis and Mining, 2019
- SentiALG: Automated Corpus Annotation for Algerian Sentiment Analysis2018
- Arabic Tweets Sentimental Analysis Using Machine Learning2017
- Measuring nominal scale agreement among many raters.Psychological Bulletin, 1971