Face-Off: Adversarial Face Obfuscation
Authors:
Open Access
- 29 January 2021
- journal article
- research article
- Published by Privacy Enhancing Technologies Symposium Advisory Board in Proceedings on Privacy Enhancing Technologies
- Vol. 2021 (2) , 369-390
Abstract
Advances in deep learning have made face recognition technologies pervasive. While useful to social media platforms and users, this technology carries significant privacy threats. Coupled with the abundant information they have about users, service providers can associate users with social interactions, visited places, activities, and preferences–some of which the user may not want to share. Additionally, facial recognition models used by various agencies are trained by data scraped from social media platforms. Existing approaches to mitigate associated privacy risks result in an imbalanced trade-off between privacy and utility. In this paper, we address this trade-off by proposing Face-Off, a privacy-preserving framework that introduces strategic perturbations to images of the user’s face to prevent it from being correctly recognized. To realize Face-Off, we overcome a set of challenges related to the black-box nature of commercial face recognition services, and the scarcity of literature for adversarial attacks on metric networks. We implement and evaluate Face-Off to find that it deceives three commercial face recognition services from Microsoft, Amazon, and Face++. Our user study with 423 participants further shows that the perturbations come at an acceptable cost for the users.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- On the Design of Black-Box Adversarial Examples by Leveraging Gradient-Free Optimization and Operator Splitting Method2019
- Adversarial Attacks on Face Detectors Using Neural Net Based Constrained Optimization2018
- SphereFace: Deep Hypersphere Embedding for Face Recognition2017
- Towards Evaluating the Robustness of Neural Networks2017
- Practical Black-Box Attacks against Machine Learning2017
- Accessorize to a Crime2016
- FaceNet: A unified embedding for face recognition and clustering2015
- DeepFace: Closing the Gap to Human-Level Performance in Face Verification2014
- Face De-identification2009
- Over-exposed?2007