Leveraging distant supervision and deep learning for twitter sentiment and emotion classification
Open Access
- 22 March 2024
- journal article
- research article
- Published by Springer Nature in Journal of Intelligent Information Systems
- Vol. 62 (4) , 1045-1070
Abstract
Nowadays, various applications across industries, healthcare, and security have begun adopting automatic sentiment analysis and emotion detection in short texts, such as posts from social media. Twitter stands out as one of the most popular online social media platforms due to its easy, unique, and advanced accessibility using the API. On the other hand, supervised learning is the most widely used paradigm for tasks involving sentiment polarity and fine-grained emotion detection in short and informal texts, such as Twitter posts. However, supervised learning models are data-hungry and heavily reliant on abundant labeled data, which remains a challenge. This study aims to address this challenge by creating a large-scale real-world dataset of 17.5 million tweets. A distant supervision approach relying on emojis available in tweets is applied to label tweets corresponding to Ekman’s six basic emotions. Additionally, we conducted a series of experiments using various conventional machine learning models and deep learning, including transformer-based models, on our dataset to establish baseline results. The experimental results and an extensive ablation analysis on the dataset showed that BiLSTM with FastText and an attention mechanism outperforms other models in both classification tasks, achieving an F1-score of 70.92% for sentiment classification and 54.85% for emotion detection.Keywords
Funding Information
- Linnaeus University
This publication has 35 references indexed in Scilit:
- Sentiment Polarity and Emotion Detection from Tweets Using Distant Supervision and Deep Learning Models2022
- The Potential of Machine Learning Algorithms for Sentiment Classification of Students’ Feedback on MOOC2021
- Sentiment analysis2021
- Emotion Recognition by Textual Tweets Classification Using Voting Classifier (LR-SGD)IEEE Access, 2020
- Cross-Cultural Polarity and Emotion Detection Using Sentiment Analysis and Deep Learning on COVID-19 Related TweetsIEEE Access, 2020
- Advances in Social Media Research: Past, Present and FutureInformation Systems Frontiers, 2017
- Deep learningNature, 2015
- Distant Supervision for Emotion Classification with Discrete Binary Values2013
- Facial expression and emotion.American Psychologist, 1993
- A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION1980