Machine Learning and Deep Learning Sentiment Analysis Models: Case Study on the SENT-COVID Corpus of Tweets in Mexican Spanish
Open Access
- 23 April 2024
- journal article
- research article
- Published by MDPI AG in Informatics
- Vol. 11 (2) , 24
Abstract
This article presents a comprehensive evaluation of traditional machine learning and deep learning models in analyzing sentiment trends within the SENT-COVID Twitter corpus, curated during the COVID-19 pandemic. The corpus, filtered by COVID-19 related keywords and manually annotated for polarity, is a pivotal resource for conducting sentiment analysis experiments. Our study investigates various approaches, including classic vector-based systems such as word2vec, doc2vec, and diverse phrase modeling techniques, alongside Spanish pre-trained BERT models. We assess the performance of readily available sentiment analysis libraries for Python users, including TextBlob, VADER, and Pysentimiento. Additionally, we implement and evaluate traditional classification algorithms such as Logistic Regression, Naive Bayes, Support Vector Machines, and simple neural networks like Multilayer Perceptron. Throughout the research, we explore different dimensionality reduction techniques. This methodology enables a precise comparison among classification methods, with BETO-uncased achieving the highest accuracy of 0.73 on the test set. Our findings underscore the efficacy and applicability of traditional machine learning and deep learning models in analyzing sentiment trends within the context of low-resource Spanish language scenarios and emerging topics like COVID-19.Keywords
Funding Information
- Secretaría de Ciencia, Humanidades, Tecnología e Innovación (CF-2023-G-64, TA101722, IN104424)
- Universidad Nacional Autónoma de México (CF-2023-G-64, TA101722, IN104424)
This publication has 61 references indexed in Scilit:
- Sentiment analysis of COVID-19 cases in Greece using Twitter dataExpert Systems with Applications, 2023
- Deep Learning Model for COVID-19 Sentiment Analysis on TwitterNew Generation Computing, 2023
- Spanish Corpora of tweets about COVID-19 vaccination for automatic stance detectionInformation Processing & Management, 2023
- Attention mechanisms in computer vision: A surveyComputational Visual Media, 2022
- An augmented multilingual Twitter dataset for studying the COVID-19 infodemicSocial Network Analysis and Mining, 2021
- Sentiment analysis and its applications in fighting COVID-19 and infectious diseases: A systematic reviewExpert Systems with Applications, 2021
- Systematic reviews in sentiment analysis: a tertiary studyArtificial Intelligence Review, 2021
- Topic detection and sentiment analysis in Twitter content related to COVID-19 from Brazil and the USAApplied Soft Computing, 2021
- Design and analysis of a large-scale COVID-19 tweets datasetApplied Intelligence, 2020
- State-of-the-art in artificial neural network applications: A surveyHeliyon, 2018