Leveraging Transfer Learning for Hate Speech Detection in Portuguese Social Media Posts
Open Access
- 18 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 101374-101389
Abstract
The rapid rise of social media has brought about new ways of digital communication, along with a worrying increase in online hate speech (HS), which, in turn, has led researchers to develop several Natural Language Processing methods for its detection. Although significant strides have been made in automating HS detection, research focusing on the European Portuguese language remains scarce (as it happens in several under-resourced languages). To address this gap, we explore the efficacy of various transfer learning models, which have been shown in the literature to have better performance for this task than other Deep Learning models. We employ BERT-like models pre-trained on Portuguese text, such as BERTimbau and mDeBERTa, as well as GPT, Gemini and Mistral generative models, for the detection of HS within Portuguese online discourse. Our study relies on two annotated corpora of YouTube comments and tweets, both annotated as HS and non-HS. Our findings show that the best model for the YouTube corpus was a variant of BERTimbau retrained with European Portuguese tweets and fine-tuned for the HS task, with an F-score of 87.1% for the positive class, outperforming the baseline models by more than 20% and with a 1.8% increase compared with base BERTimbau. The best model for the Twitter corpus was GPT-3.5, with an F-score of 50.2% for the positive class. We also assess the impact of using in-domain and mixed-domain training sets, as well as the impact of providing context in generative model prompts on their performance.Keywords
Funding Information
- European Commission (CERV-2021-EQUAL (101049306))
This publication has 49 references indexed in Scilit:
- Improving hate speech detection using Cross-Lingual LearningExpert Systems with Applications, 2023
- Leveraging posts’ and authors’ metadata to spot several forms of abusive comments in TwitterJournal of Intelligent Information Systems, 2023
- A transfer learning approach for detecting offensive and hate speech on social media platformsMultimedia Tools and Applications, 2023
- Detecting offensive speech in conversational code-mixed dialogue on social media: A contextual dataset and benchmark experimentsExpert Systems with Applications, 2022
- Covert Hate Speech, Conspiracy Theory and Anti-semitism: Linguistic Analysis Versus Legal JudgementInternational Journal for the Semiotics of Law - Revue internationale de Sémiotique juridique, 2022
- Using Cross Lingual Learning for Detecting Hate Speech in Portuguese2021
- Detecting abusive Instagram comments in Turkish using convolutional Neural network and machine learning methodsExpert Systems with Applications, 2021
- Comparing pre-trained language models for Spanish hate speech detectionExpert Systems with Applications, 2021
- BERTimbau: Pretrained BERT Models for Brazilian Portuguese2020
- Resources and benchmark corpora for hate speech detection: a systematic reviewLanguage Resources and Evaluation, 2020