Real-time Twitter Sentiment Analysis for Moroccan Universities using Machine Learning and Big Data Technologies
Open Access
- 7 March 2023
- journal article
- research article
- Published by International Association of Online Engineering (IAOE) in International Journal of Emerging Technologies in Learning (iJET)
- Vol. 18 (05) , 42-61
Abstract
In recent years, sentiment analysis (SA) has raised the interest of researchers in several domains, including higher education. It can be applied to measure the quality of the services supplied by the higher education institution and construct a university ranking mechanism from social media like Twitter. Hence, this study presents a novel system for Twitter sentiment prediction on Moroccan public universities in real-time. It consists of two phases: offline sentiment analysis phase and real-time prediction phase. In the offline phase, the collected French tweets about twelve Moroccan universities were classified according to their sentiment into ‘positive’, ‘negative’, or ‘neutral’ using six machine learning algorithms (random forest, multinomial Naive Bayes classifier, logistic regression, decision tree, linear support vector classifier, and extreme gradient boosting) with the term frequency-inverse document frequency (TF-IDF) and count vectorizer feature extraction techniques. The results reveal that random forest classifier coupled with TF-IDF has obtained the best test accuracy of 90%. This model was then applied on real-time tweets. The real-time prediction pipeline comprises Twitter streaming API for data collection, Apache Kafka for data ingestion, Apache Spark for real-time sentiment analysis, Elasticsearch for real-time data exploration, and Kibana for data visualization. The obtained results can be used by the Ministry of higher education, scientific research and innovation of Morocco for decision-making process.Keywords
This publication has 31 references indexed in Scilit:
- Sentiment analysis in higher education: a systematic mapping reviewJournal of Physics: Conference Series, 2021
- Tourism destination management using sentiment analysis and geo-location information: a deep learning approachInformation Technology & Tourism, 2021
- Twitter Sentiment Analysis on Coronavirus: Machine Learning ApproachJournal of Physics: Conference Series, 2021
- Analysis of Political Sentiment Orientations on TwitterProcedia Computer Science, 2020
- Tweets Sentiment Analysis for Healthcare on Big Data Processing and IoT Architecture Using Maximum Entropy Classifier2018
- Twitter Sentiment to Analyze Net Brand Reputation of Mobile Phone ProvidersProcedia Computer Science, 2015
- Learning Sentiment from Students’ Feedback for Real-Time Interventions in Classrooms2014
- Top 10 algorithms in data miningKnowledge and Information Systems, 2007
- Understanding inverse document frequency: on theoretical arguments for IDFJournal of Documentation, 2004
- Support-vector networksMachine Learning, 1995