The FRENK Datasets of Socially Unacceptable Discourse in Slovene and English
Preprint
Abstract
In this paper we present datasets of Facebook comment threads to mainstream media posts in Slovene and English developed inside the Slovene national project FRENK which cover two topics, migrants and LGBT, and are manually annotated for different types of socially unacceptable discourse (SUD). The main advantages of these datasets compared to the existing ones are identical sampling procedures, producing comparable data across languages and an annotation schema that takes into account six types of SUD and five targets at which SUD is directed. We describe the sampling and annotation procedures, and analyze the annotation distributions and inter-annotator agreements. We consider this dataset to be an important milestone in understanding and combating SUD for both languages.Keywords
All Related Versions
This publication has 3 references indexed in Scilit:
- Automated Hate Speech Detection and the Problem of Offensive LanguageProceedings of the International AAAI Conference on Web and Social Media, 2017
- Ex Machina2017
- Content Analysis: An Introduction to its Methodology.Journal of the American Statistical Association, 1984