Combating Abusive Information in Encrypted Messaging Services: A Secure and Efficient Realization
- 1 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Services Computing
- Vol. 18 (6) , 3581-3594
Abstract
End-to-end encrypted messaging services (EEMSs) empower private communication through encrypting messages, yet also make content moderation for combating the spread of abusive messages challenging. There is an urgent call for supporting content moderation in EEMSs while ensuring user privacy. In this paper, we present a new system design for privacy-assured content moderation in EEMSs. At a high level, users in our system can privately report abusive messages, and the EEMS traces the source if a message has an aggregated report count exceeding a predefined threshold and is audited to be abusive. Our system mainly departs from prior works in that it allows flexible and adaptable thresholds, offers robustness against dishonest reporters providing malformed reports, and better ensures the privacy of all users during the moderation process. We also take a step further and propose a privacy-aware detection mechanism that relies on a blocklist built with transparency to mitigate the further spread of identified abusive messages from forwarders. Formal security analysis is provided and extensive experiments demonstrate the practical efficiency of our system.Keywords
Funding Information
- National Cryptologic Science Fund of China (2025NCSF02033)
- Hong Kong Research Grants Council (CityU 11218322)
- Hong Kong Research Grants Council (11219524)
- Hong Kong Research Grants Council (R6021-20F)
- Hong Kong Research Grants Council (R1012-21)
- Hong Kong Research Grants Council (RFS21221S04)
- Hong Kong Research Grants Council (C2004-21G)
- Hong Kong Research Grants Council (C1029-22G)
- Hong Kong Research Grants Council (C6015-23G)
- Hong Kong Research Grants Council (N_CityU139/21)
- Innovation and Technology Commission
- Joint Mainland-Hong Kong Funding Scheme (MHP/135/23)
- InnoHK Initiative, The Government of the HKSAR
- Laboratory for AI-Powered Financial Technologies
This publication has 37 references indexed in Scilit:
- Nemesis: Combating Abusive Information in Encrypted Messaging with Private Reporting2024
- End-to-End Secure Messaging with Traceability Only for Illegal Content2023
- Anonymous Traceback for End-to-End Encryption2022
- Function Secret Sharing for Mixed-Mode and Fixed-Point Secure Computation2021
- Secure Computation with Preprocessing via Function Secret Sharing2019
- SpOT-Light: Lightweight Private Set Intersection from Sparse OT Extension2019
- Asymmetric Message Franking: Content Moderation for Metadata-Private End-to-End Encryption2019
- Simplified Threshold RSA with Adaptive and Proactive Security2006
- Efficient Multiparty Protocols Using Circuit Randomization2001
- Practical Threshold Signatures2000