Measuring Online Hate on 4chan Using Pre-Trained Deep Learning Models
- 27 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Technology and Society
- Vol. 6 (2) , 200-209
Abstract
Online hate speech can harmfully impact individuals and groups, specifically on non-moderated platforms such as 4chan where users can post anonymous content. This work focuses on analysing and measuring the prevalence of online hate on 4chan’s politically incorrect board (/pol/) using state-of-the-art Natural Language Processing (NLP) models, specifically transformer-based models such as RoBERTa and Detoxify. By leveraging these advanced models, we provide an in-depth analysis of hate speech dynamics and quantify the extent of online hate non-moderated platforms. The study advances understanding through multi-class classification of hate speech (racism, sexism, religion, etc.), while also incorporating the classification of toxic content (e.g., identity attacks and threats) and a further topic modelling analysis. The results show that 11.20% of this dataset is identified as containing hate in different categories. These evaluations show that online hate is manifested in various forms, confirming the complicated and volatile nature of detection in the wild.Keywords
All Related Versions
Funding Information
- U.K. Research and Innovation
- Strategic Priority Fund
- Protecting Citizens Online programme (EP/W032481/2)
This publication has 25 references indexed in Scilit:
- The Great Ban: Efficacy and Unintended Consequences of a Massive Deplatforming Operation on Reddit2024
- Measuring Hate: Does a Definition Affect Self-Reported Levels of Perpetration and Exposure to Online Hate in Surveys?Social Science Computer Review, 2023
- Hate speech, toxicity detection in online social media: a recent survey of state of the art and opportunitiesInternational Journal of Information Security, 2023
- From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIACM Computing Surveys, 2023
- Analyzing Hate Speech Against Women on InstagramOpen Information Science, 2023
- Beyond Anonymity: Network Affordances, Under Deindividuation, Improve Social Media Discussion QualityJournal of Computer-Mediated Communication, 2021
- Assessing the Extent and Types of Hate Speech in Fringe Communities: A Case Study of Alt-Right Communities on 8chan, 4chan, and RedditSocial Media + Society, 2021
- Developing an online hate classifier for multiple social media platformsHuman-centric Computing and Information Sciences, 2020
- Hate speech detection: Challenges and solutionsPLOS ONE, 2019
- A Survey on Automatic Detection of Hate Speech in TextACM Computing Surveys, 2018