Collab: Fostering Critical Identification of Deepfake Videos on Social Media via Synergistic Annotation
Open Access
- 13 April 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-21
Abstract
Identifying deepfake videos on social media platforms is challenged by dynamic spatio-temporal artifacts and inadequate user tools. This hinders both critical viewing by users and scalable moderation on platforms. Here, we present Collab, a web plugin enabling users to collaboratively annotate deepfake videos. Collab integrates three key components: (i) an intuitive interface for spatio-temporal labeling where users provide confidence scores and rationales, facilitating detailed input even from non-experts, (ii) a novel confidence-weighted spatio-temporal Intersection-over-Union (IoU) algorithm to aggregate diverse user annotations into accurate aggregations, and (iii) a hierarchical demonstration strategy presenting aggregated results to guide attention toward contentious regions and foster critical evaluation. A seven-day online study (N = 90), where participants annotated suspicious videos when viewing an online experimental platforms, compared Collab against two conditions without aggregation or demonstration respectively. Collab significantly improved identification accuracy and enhanced reflection compared to non-demonstration condition, while outperforming non-aggregation condition for its novelty and effectiveness.Keywords
All Related Versions
This publication has 107 references indexed in Scilit:
- Human performance in detecting deepfakes: A systematic review and meta-analysis of 56 papersComputers in Human Behavior Reports, 2024
- Misinformation warning labels are widely effective: A review of warning effects and their moderating featuresCurrent Opinion in Psychology, 2023
- Aggregating user preferences in group recommender systems: A crowdsourcing approachDecision Support Systems, 2022
- Can the crowd judge truthfulness? A longitudinal study on recent misinformation about COVID-19Personal and Ubiquitous Computing, 2021
- Leveraging crowd skills and consensus for collaborative web-resource labelingFuture Generation Computer Systems, 2019
- Scientific collaboration dynamics in a national scientific systemScientometrics, 2015
- An interactive tool for manual, semi-automatic and automatic video annotationComputer Vision and Image Understanding, 2015
- Multimodal Integration of Dynamic Audio–Visual Cues in the Communication of Agreement and DisagreementJournal of Nonverbal Behavior, 2014
- Conformity on the Internet – The role of task difficulty and gender differencesComputers in Human Behavior, 2012
- Computational Efficiency through Visual Argument: Do Graphic Organizers Communicate Relations in Text Too Effectively?Contemporary Educational Psychology, 1994