MC-BERT4HATE: Hate Speech Detection using Multi-channel BERT for Different Languages and Translations
Authors:
- 1 November 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 551-559
Abstract
The growth of social networking services (SNS) has altered the way and scale of communication in cyberspace. However, the amount of online hate speech is increasing because of the anonymity and mobility such services provide. As manual hate speech detection by human annotators is both costly and time consuming, there are needs to develop an algorithm for automatic recognition. Transferring knowledge by fine-tuning a pre-trained language model has been shown to be effective for improving many downstream tasks in the field of natural language processing. The Bidirectional Encoder Representations from Transformers (BERT) is a language model that is pre-trained to learn deep bidirectional representations from a large corpus. In this paper, we propose a multi-channel model with three versions of BERT (MC-BERT), the English, Chinese, and multilingual BERTs for hate speech detection. We also explored the usage of translations as additional input by translating training and test sentences to the corresponding languages required for different BERT models. We used three datasets in non-English languages to compare our model with previous approaches including the 2019 SemEval HatEval Spanish dataset, 2018 GermEval shared task on the identification of Offensive Language dataset, and 2018 EvalIta HaSpeeDe Italian dataset. Finally, we were able to achieve the state-of-the-art or comparable performance on these datasets by conducting thorough experiments.Keywords
This publication has 21 references indexed in Scilit:
- Hate speech detection in the Indonesian language: A dataset and preliminary study2017
- A Survey on Hate Speech Detection using Natural Language Processing2017
- Abusive Language Detection in Online User Content2016
- Neural Machine Translation of Rare Words with Subword Units2016
- Glove: Global Vectors for Word Representation2014
- Convolutional Neural Networks for Sentence Classification2014
- Improving Cyberbullying Detection with User Context2013
- Detecting Offensive Language in Social Media to Protect Adolescent Online Safety2012
- Long Short-Term MemoryNeural Computation, 1997
- Finding structure in timeCognitive Science, 1990