Attribute-Preserving Face Dataset Anonymization via Latent Code Optimization
Authors:
- 1 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 8001-8010
Abstract
This work addresses the problem of anonymizing the identity of faces in a dataset of images, such that the privacy of those depicted is not violated, while at the same time the dataset is useful for downstream task such as for training machine learning models. To the best of our knowledge, we are the first to explicitly address this issue and deal with two major drawbacks of the existing state-of-the-art approaches, namely that they (i) require the costly training of additional, purpose-trained neural networks, and/or (ii) fail to retain the facial attributes of the original images in the anonymized counterparts, the preservation of which is of paramount importance for their use in downstream tasks. We accordingly present a task-agnostic anonymization procedure that directly optimizes the images' latent representation in the latent space of a pretrained GAN. By optimizing the latent codes directly, we ensure both that the identity is of a desired distance away from the original (with an identity obfuscation loss), whilst preserving the facial attributes (using a novel feature-matching loss in FaRL's [48] deep feature space). We demonstrate through a series of both qualitative and quantitative experiments that our method is capable of anonymizing the identity of the images whilst-crucially-better-preserving the facial attributes. We make the code and the pretrained models publicly available at: https://github.com/chi0tzp/FALCO.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Faceless Person Recognition: Privacy Implications in Social Media2016
- Joint Face Detection and Alignment Using Multitask Cascaded Convolutional NetworksIEEE Signal Processing Letters, 2016
- Deep Learning Face Attributes in the Wild2015
- FaceNet: A unified embedding for face recognition and clustering2015
- Pixelated image abstraction with integrated user constraintsComputers & Graphics, 2013
- Tools for Protecting the Privacy of Specific Individuals in VideoEURASIP Journal on Advances in Signal Processing, 2007
- Blur filtration fails to preserve privacy for home-based video conferencingACM Transactions on Computer-Human Interaction, 2006
- Preserving privacy by de-identifying face imagesIEEE Transactions on Knowledge and Data Engineering, 2005
- Privacy protection by concealing persons in circumstantial video image2001
- The effects of filtered video on awareness and privacy2000