A real-time predicting online tool for detection of people’s emotions from Arabic tweets based on big data platforms
Open Access
- 25 November 2024
- journal article
- research article
- Published by Springer Nature in Journal of Big Data
- Vol. 11 (1) , 1-24
Abstract
Emotion prediction is a subset of sentiment analysis that aims to extract emotions from text, speech, or images. The researchers posit that emotions determine human behavior, making the development of a method to recognize emotions automatically crucial for use during global crises, such as the COVID-19 pandemic. In this paper, a real-time system is developed that identifies and predicts emotions conveyed by users in Arabic tweets regarding COVID-19 into standard six emotions based on the big data platform, Apache Spark. The system consists of two main stages: (1) Developing an offline model and (2) Online emotion prediction pipeline. For the first stage, two different approaches: The deep Learning (DL) approach and the Transfer Learning-based (TL) approach to find the optimal classifier for identifying and predicting emotion. For DL, three classifiers are applied: Convolutional Neural Network (CNN), Gated Recurrent Unit (GRU), and Bidirectional GRU (BiGRU). For TL, five models are applied: AraBERT, ArabicBERT, ARBERT, MARBERT, and QARiB. For the second stage, create a Transmission Control Protocol (TCP) socket between Twitter’s API and Spark used to receive streaming tweets and Apache Spark to predict the label of tweets in real-time. The experimental results show that the QARiB model achieved the highest Jaccard accuracy (65.73%), multi-accuracy (78.71%), precision-micro (78.71%), recall-micro (78.71%), f-micro (78.71%), and f-macro (78.55%). The system is available as a web-based application that aims to provide a real-time visualization of people’s emotions during a crisis.Keywords
Funding Information
- Assiut University
This publication has 24 references indexed in Scilit:
- Stacked-CNN-BiLSTM-COVID: an effective stacked ensemble deep learning framework for sentiment analysis of Arabic COVID-19 tweetsJournal of Cloud Computing, 2024
- Analyzing Large-Scale Twitter Real Time Streaming Data with Manifold Machine Learning Algorithms in Apache SPARK2023
- Sentiment Analysis of Twitter Data Using Big Data Analytics and Deep Learning Model2023
- Deep learning for emotion analysis in Arabic tweetsJournal of Big Data, 2021
- A novel fusion-based deep learning model for sentiment analysis of COVID-19 tweetsKnowledge-Based Systems, 2021
- SEDAT: Sentiment and Emotion Detection in Arabic Text Using CNN-LSTM Deep Learning2018
- Emotional Tone Detection in Arabic Tweets2018
- Saudi Mood: A Real-Time Informative Tool for Visualizing Emotions in Saudi Arabia Using Twitter2018
- A web-based tool for Arabic sentiment analysisProcedia Computer Science, 2017
- Backpropagation Applied to Handwritten Zip Code RecognitionNeural Computation, 1989