Gender Privacy Angular Constraints for Face Recognition
Open Access
- 17 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biometrics, Behavior, and Identity Science
- Vol. 6 (3) , 352-363
Abstract
Deep learning-based face recognition systems produce templates that encode sensitive information next to identity, such as gender and ethnicity. This poses legal and ethical problems as the collection of biometric data should be minimized and only specific to a designated task. We propose two privacy constraints to hide the gender attribute that can be added to a recognition loss. The first constraint relies on the minimization of the angle between gender-centroid embeddings. The second constraint relies on the minimization of the angle between gender specific embeddings and their opposing gender-centroid weight vectors. Both constraints enforce the overlapping of the gender specific distributions of the embeddings. Furthermore, they have a direct interpretation in the embedding space and do not require a large number of trainable parameters as two fully connected layers are sufficient to achieve satisfactory results. We also provide extensive evaluation results across several datasets and face recognition networks, and we compare our method to three state-of-the-art methods. Our method is capable of maintaining high verification performances while significantly improving privacy in a cross-database setting, without increasing the computational load for template comparison. We also show that different training data can result in varying levels of effectiveness of privacy-enhancing methods that implement data minimization.Keywords
Funding Information
- European Union’s Horizon 2020 Research and Innovation Programme (860315)
This publication has 34 references indexed in Scilit:
- Transferability analysis of adversarial attacks on gender classification to face recognition: Fixed and variable attack perturbationIET Biometrics, 2022
- PE-MIU: A Training-Free Privacy-Enhancing Face Recognition Approach Based on Minimum Information UnitsIEEE Access, 2020
- FlowSAN: Privacy-Enhancing Semi-Adversarial Networks to Confound Arbitrary Face-Based Gender ClassifiersIEEE Access, 2019
- Measuring the Gender and Ethnicity Bias in Deep Models for Face Recognition2019
- Unsupervised privacy-enhancement of face representations using similarity-sensitive noise transformationsApplied Intelligence, 2019
- Soft biometric privacy: Retaining biometric utility of face images while perturbing gender2017
- How Transferable Are CNN-Based Features for Age and Gender Classification?2016
- MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition2016
- Privacy of Facial Soft Biometrics: Suppressing Gender But Retaining Identity2015
- The FERET evaluation methodology for face-recognition algorithmsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000