Taking the control back – An adventure in developing personalized content moderation
Open Access
- 13 April 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-25
Abstract
Online platforms are riddled with harassment, which significantly impacts the well-being of users. Unfortunately, the content moderation solutions provided by platforms often disappoint end-users as they fail to equip individuals with sufficient controls for their personal situations. In this work, the author, who personally experienced a sustained harassment campaign on Twitter, decided to regain control by constructing an automated, personalized, and collaborative anti-harassment system to protect herself, which has proven itself to be effective. The experience of developing—and re-developing in the face of repeated platform API changes and restrictions—this personalized content moderation system highlights many design issues that make managing severe online harassment such a challenge and invites critical study of the power dynamics between large online platforms and individual users. Through this analysis, this report aims to inform better designs to help platforms more effectively protect victims.Keywords
This publication has 101 references indexed in Scilit:
- Multi-platform analysis of sexual harassment networks: gender dynamics and digital amplificationSocial Network Analysis and Mining, 2025
- Too Lucky to Be a Victim? An Exploratory Study of Online Harassment and Hate Messages Faced by Social Media InfluencersEuropean Journal on Criminal Policy and Research, 2023
- From content moderation to visibility moderation: A case study of platform governance on TikTokPolicy & Internet, 2022
- Decentralized Networks vs The Trolls2022
- Understanding the growth of the Fediverse through the lens of MastodonApplied Network Science, 2021
- Fighting Hate Speech, Silencing Drag Queens? Artificial Intelligence in Content Moderation and Risks to LGBTQ Voices OnlineSexuality & Culture, 2020
- Autoethnography in Human-Computer Interaction: Theory and Practice2018
- TrollBusters: Fighting Online Harassment of Women Journalists2018
- The Impact of Toxic Language on the Health of Reddit Communities2017
- On Textual Analysis and Machine Learning for Cyberstalking DetectionDatenbank-Spektrum, 2016