Privacy-preserving Adversarial Facial Features
Authors:
- 1 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 8212-8221
Abstract
Face recognition service providers protect face privacy by extracting compact and discriminative facial features (representations) from images, and storing the facial features for real-time recognition. However, such features can still be exploited to recover the appearance of the original face by building a reconstruction network. Although sev-eral privacy-preserving methods have been proposed, the enhancement offace privacy protection is at the expense of accuracy degradation. In this paper, we propose an adver-sarial features-based face privacy protection (AdvFace) approach to generate privacy-preserving adversarial features, which can disrupt the mapping from adversarial features to facial images to defend against reconstruction attacks. To this end, we design a shadow model which simulates the attackers' behavior to capture the mapping function from facial features to images and generate adversarial la-tent noise to disrupt the mapping. The adversarial features rather than the original features are stored in the server's database to prevent leaked features from exposing facial information. Moreover, the AdvFace requires no changes to the face recognition network and can be implemented as a privacy-enhancing plugin in deployed face recognition systems. Extensive experimental results demonstrate that Adv Face outperforms the state-of-the-art face privacy-preserving methods in defending against reconstruction at-tacks while maintaining face recognition accuracy.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62122066,U20A20182,61872274,62102337)
This publication has 26 references indexed in Scilit:
- Joint Face Detection and Alignment Using Multitask Cascaded Convolutional NetworksIEEE Signal Processing Letters, 2016
- Deep Residual Learning for Image Recognition2016
- Frontal to profile face verification in the wild2016
- Deep Learning Face Attributes in the Wild2015
- Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures2015
- Simple Functional Encryption Schemes for Inner Products2015
- Reconstructing faces from their signatures using RBF regression2013
- Implementing Gentry’s Fully-Homomorphic Encryption Scheme2011
- From Scores to Face Templates: A Model-Based ApproachIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004