Revisiting Contextual Toxicity Detection in Conversations
Open Access
- 28 December 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Journal of Data and Information Quality
- Vol. 15 (1) , 1-22
Abstract
Understanding toxicity in user conversations is undoubtedly an important problem. Addressing “covert” or implicit cases of toxicity is particularly hard and requires context. Very few previous studies have analysed the influence of conversational context in human perception or in automated detection models. We dive deeper into both these directions. We start by analysing existing contextual datasets and find that toxicity labelling by humans is in general influenced by the conversational structure, polarity, and topic of the context. We then propose to bring these findings into computational detection models by introducing and evaluating (a) neural architectures for contextual toxicity detection that are aware of the conversational structure, and (b) data augmentation strategies that can help model contextual toxicity detection. Our results show the encouraging potential of neural architectures that are aware of the conversation structure. We also demonstrate that such models can benefit from synthetic data, especially in the social media domain.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- A Just and Comprehensive Strategy for Using NLP to Address Online Abuse2019
- End-to-End Open-Domain Question Answering with2019
- Measuring and Mitigating Unintended Bias in Text Classification2018
- Understanding Back-Translation at Scale2018
- Fighting Offensive Language on Social Media with Unsupervised Text Style Transfer2018
- Detecting Online Hate Speech Using Context Aware Models2017
- Understanding Abuse: A Typology of Abusive Language Detection Subtasks2017
- DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis2017
- Improving Neural Machine Translation Models with Monolingual Data2016
- Conversational Markers of Constructive Discussions2016