SafeScreen: Evaluating a Screen-Detecting Smartphone Camera App under Benign and Adversarial Use MHCI025
Open Access
- 9 September 2025
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 9 (5) , 1-27
Abstract
Camera-equipped smartphones pose security risks to organisations by allowing intentional or accidental leaks of confidential on-screen information. We introduce SafeScreen, an Android camera app that detects and obfuscates screen content in real-time using deep-learning recognition for distant screens and Moiré pattern detection for close-up screen captures. Our mixed-methods, ecologically focused study compared “benign” (ordinary photography) and “malign” (circumventing detection) uses. Results show SafeScreen effectively prevents accidental leaks, but that the majority of users were able to exploit it by discovering workarounds such as partial screen occlusion. Our work contributes (1) a novel screen-blocking camera system, and (2) insights from real-world, unguided interactions. We show how evaluating security systems in authentic settings uncovers user-driven vulnerabilities and frustrations that inform future researchers and organisations. We close by discussing future technical features which could offer usability or security improvements, as well as emphasising the benefits of unscripted and adversarial user evaluations.Keywords
Funding Information
- Foreign, Commonwealth and Development Office (SafeScreen)
This publication has 46 references indexed in Scilit:
- Detection of Moiré pattern in high-resolution imagesSignal, Image and Video Processing, 2023
- The security mindset: characteristics, development, and consequencesJournal of Cybersecurity, 2023
- An evaluation of deep learning based object detection strategies for threat object detection in baggage security imageryPattern Recognition Letters, 2019
- A Survey of Deep Learning-Based Object DetectionIEEE Access, 2019
- A Deep Learning Approach for Road Damage Detection from Smartphone Images2018
- Workarounds and trade-offs in information security – an exploratory studyInformation & Computer Security, 2017
- A new IoT combined body detection of people by using computer vision for security application2017
- A typology of hackers: Classifying cyber malfeasance using a weighted arc circumplex modelDigital Investigation, 2015
- Summary for Policymakers2014
- Moiré PatternsScientific American, 1963