Hate Speech Detection and Racial Bias Mitigation in Social Media based on BERT model
Preprint
Abstract
Disparate biases associated with datasets and trained classifiers in hateful and abusive content identification tasks have raised many concerns recently. Although the problem of biased datasets on abusive language detection has been addressed more frequently, biases arising from trained classifiers have not yet been a matter of concern. Here, we first introduce a transfer learning approach for hate speech detection based on an existing pre-trained language model called BERT and evaluate the proposed model on two publicly available datasets annotated for racism, sexism, hate or offensive content on Twitter. Next, we introduce a bias alleviation mechanism in hate speech detection task to mitigate the effect of bias in training set during the fine-tuning of our pre-trained BERT-based model. Toward that end, we use an existing regularization method to reweight input samples, thereby decreasing the effects of high correlated training set' s n-grams with class labels, and then fine-tune our pre-trained BERT-based model with the new re-weighted samples. To evaluate our bias alleviation mechanism, we employ a cross-domain approach in which we use the trained classifiers on the aforementioned datasets to predict the labels of two new datasets from Twitter, AAE-aligned and White-aligned groups, which indicate tweets written in African-American English (AAE) and Standard American English (SAE) respectively. The results show the existence of systematic racial bias in trained classifiers as they tend to assign tweets written in AAE from AAE-aligned group to negative classes such as racism, sexism, hate, and offensive more often than tweets written in SAE from White-aligned. However, the racial bias in our classifiers reduces significantly after our bias alleviation mechanism is incorporated. This work could institute the first step towards debiasing hate speech and abusive language detection systems.Keywords
All Related Versions
- Version 1, 2020-08-14, ArXiv
- Version 2, 2020-08-28, ArXiv
- Published version: PLOS ONE, 15 (8), e0237861.
This publication has 19 references indexed in Scilit:
- Detecting weak and strong Islamophobic hate speech on social mediaJournal of Information Technology & Politics, 2019
- Content Similarity Analysis of Written Comments under Posts in Social Media2019
- Stereotypical Bias Removal for Hate Speech Detection Task using Knowledge-based Generalizations2019
- Measuring and Mitigating Unintended Bias in Text Classification2018
- A Survey on Automatic Detection of Hate Speech in TextACM Computing Surveys, 2018
- Bridging the Gaps: Multi Task Learning for Domain Transfer of Hate Speech Detection2018
- Detecting Hate Speech on Twitter Using a Convolution-GRU Based Deep Neural Network2018
- Challenges in discriminating profanity from hate speechJournal of Experimental & Theoretical Artificial Intelligence, 2017
- Enriching Word Vectors with Subword InformationTransactions of the Association for Computational Linguistics, 2017
- Deep Learning for Hate Speech Detection in Tweets2017