ACOM: Arabic Comparative Opinion Mining in Social Media Utilizing Word Embedding, Deep Learning Model, & LLM-GPT
Open Access
- 8 October 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 148741-148755
Abstract
Reliance on social networks has become an integral part of modern daily activities. Social networks are crowded with vast numbers of comments, opinions, and beliefs about different aspects of people’s daily lives. Opinions can directly express positive or negative perspectives toward a specific entity or its aspects, or they can be comparative opinions that present the differences or similarities between two or more entities, such as “product A is better than product B.’’ Comparative opinions have significant potential to offer new opportunities across various fields such as marketing, education, and e-commerce. Thus, analyzing comparative opinions is essential. Indeed, comparative opinion mining has been applied in several languages, including Arabic. Nevertheless, comparative opinion mining in Arabic is still in its early stages and requires more contributions and investigations. Therefore, this work introduces the ACOM approach for Arabic Comparative Opinion Mining. First, we collected the ACOM corpus in Arabic from the X platform, focusing on comparative opinions in the technology domain. This paper provides a benchmark comparison of several deep-learning models by employing different approaches, including Long Short-Term Memory (LSTM), Bidirectional LSTMs (BiLSTM), and Convolutional Neural Networks (CNN). In the deep learning model, the generated representation vector was used to construct the embedding layer as the first layer. To this end, we adopted two pretrained word embedding techniques to investigate their effectiveness on the ACOM corpus: Word2vec and Bidirectional Encoder Representations from Transformers (BERT). The main highlight of this paper is leveraging the most advanced innovation in AI, the GPT-3 model, as a classifier model. Our experimental results show that BERT and BiLSTM achieved impressive performance on the ACOM task with 91% accuracy and a 90% F1-score. Additionally, this paper discusses the impact of fine-tuning specific hyperparameters by providing a comprehensive examination.Keywords
Funding Information
- Deanship of Scientific Research (DSR) at King Abdulaziz University, Jeddah ((GPIP-1609-612-2024))
This publication has 45 references indexed in Scilit:
- Deep learning for opinion mining and topic classification of course reviewsEducation and Information Technologies, 2023
- Impact of word embedding models on text analytics in deep learning environment: a reviewArtificial Intelligence Review, 2023
- Improving the Polarity of Text through word2vec Embedding for Primary Classical Arabic Sentiment AnalysisNeural Processing Letters, 2023
- Effectiveness of Fine-tuned BERT Model in Classification of Helpful and Unhelpful Online Customer ReviewsElectronic Commerce Research, 2022
- Deep learning CNN–LSTM framework for Arabic sentiment analysis using textual information shared in social networksSocial Network Analysis and Mining, 2020
- Sentiment analysis of Arabic comparative opinionsSN Applied Sciences, 2019
- Identifying comparative opinions in Arabic text in social media using machine learning techniquesSN Applied Sciences, 2019
- Comparative opinion mining: A reviewJournal of the Association for Information Science and Technology, 2016
- Chinese Comparative Sentence Identification Based on the Combination of Rules and StatisticsLecture Notes in Computer Science, 2013
- Opinion Mining and Sentiment Analysis2011