Privacy-preserving Adversarial Facial Features
Preprint
Abstract
Face recognition service providers protect face privacy by extracting compact and discriminative facial features (representations) from images, and storing the facial features for real-time recognition. However, such features can still be exploited to recover the appearance of the original face by building a reconstruction network. Although several privacy-preserving methods have been proposed, the enhancement of face privacy protection is at the expense of accuracy degradation. In this paper, we propose an adversarial features-based face privacy protection (AdvFace) approach to generate privacy-preserving adversarial features, which can disrupt the mapping from adversarial features to facial images to defend against reconstruction attacks. To this end, we design a shadow model which simulates the attackers' behavior to capture the mapping function from facial features to images and generate adversarial latent noise to disrupt the mapping. The adversarial features rather than the original features are stored in the server's database to prevent leaked features from exposing facial information. Moreover, the AdvFace requires no changes to the face recognition network and can be implemented as a privacy-enhancing plugin in deployed face recognition systems. Extensive experimental results demonstrate that AdvFace outperforms the state-of-the-art face privacy-preserving methods in defending against reconstruction attacks while maintaining face recognition accuracy.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domain2022
- Privacy Preserving Face Recognition Utilizing Differential PrivacyComputers & Security, 2020
- SecureFace: Face Template ProtectionIEEE Transactions on Information Forensics and Security, 2020
- Joint Face Detection and Alignment Using Multitask Cascaded Convolutional NetworksIEEE Signal Processing Letters, 2016
- Learning local feature descriptors with triplets and shallow convolutional neural networks2016
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004