SSL-GAN-RoBERTa: A robust semi-supervised model for detecting Anti-Asian COVID-19 hate speech on social media
Open Access
- 3 August 2023
- journal article
- research article
- Published by Cambridge University Press (CUP) in Natural Language Engineering
- Vol. 30 (6) , 1161-1180
Abstract
Anti-Asian speech during the COVID-19 pandemic has been a serious problem with severe consequences. A hate speech wave swept social media platforms. The timely detection of Anti-Asian COVID-19-related hate speech is of utmost importance, not only to allow the application of preventive mechanisms but also to anticipate and possibly prevent other similar discriminatory situations. In this paper, we address the problem of detecting Anti-Asian COVID-19-related hate speech from social media data. Previous approaches that tackled this problem used a transformer-based model, BERT/RoBERTa, trained on the homologous annotated dataset and achieved good performance on this task. However, this requires extensive and annotated datasets with a strong connection to the topic. Both goals are difficult to meet without employing reliable, vast, and costly resources. In this paper, we propose a robust semi-supervised model, SSL-GAN-RoBERTa, that learns from a limited heterogeneous dataset and whose performance is further enhanced by using vast amounts of unlabeled data from another related domain. Compared with the RoBERTa baseline model, the experimental results show that the model has substantial performance gains in terms of Accuracy and Macro-F1 score in different scenarios that use data from different domains. Our proposed model achieves state-of-the-art performance results while efficiently using unlabeled data, showing promising applicability to other complex classification tasks where large amounts of labeled examples are difficult to obtain.Keywords
This publication has 22 references indexed in Scilit:
- Stigmatization in social media: Documenting and analyzing hate speech for COVID‐19 on TwitterProceedings of the Association for Information Science and Technology, 2020
- Unsupervised Cross-lingual Representation Learning at Scale2020
- GAN-BERT: Generative Adversarial Learning for Robust Text Classification with a Bunch of Labeled Examples2020
- A BERT-Based Transfer Learning Approach for Hate Speech Detection in Online Social Media2019
- Semi-supervised Learning for Sentiment Classification using Small Number of Labeled DataProcedia Computer Science, 2019
- Racial Bias in Hate Speech and Abusive Language Detection Datasets2019
- Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised LearningIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- Learning Adversarial Networks for Semi-Supervised Text Classification via Policy Gradient2018
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding2018
- Hate Speech Dataset from a White Supremacy Forum2018