Towards Generating High Definition Face Images from Deep Templates
Authors:
- 1 September 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-11
Abstract
Face recognition based on deep convolutional neural networks (CNN) has manifested superior accuracy. Despite the high discriminability of deep features generated by CNN, the vulnerability of the deep feature is often overlooked and leads to the security and privacy concerns, particularly the risks of reconstructing face images from the deep templates. In this paper, we propose a method to generate high definition (HD) face images from deep features. To be specific, the deep features extracted from CNN are mapped to the input (latent vector) of the pre-trained StyleGAN2 using a regression model. Subsequently, HD face images can be generated based on the latent vector by the pre-trained StyleGAN2 model. To evaluate our method, we derived the face features from the generated HD face images and compared them against the bona fide face features. In the sense of face image reconstruction, our method is simple, yet the experimental results suggest the effectiveness, which achieves an attack performance as high as SAR=46.08% (18.30%) @ FAR=0.1 threshold under type-I (type-II) attack settings. Besides, experiment results also indicate that 50.7% of the generated HD face images can pass one commercial off-the-shelf (COTS) liveness detection.Keywords
Funding Information
- Ministry of Higher Education
This publication has 9 references indexed in Scilit:
- Analyzing and Improving the Image Quality of StyleGAN2020
- A Style-Based Generator Architecture for Generative Adversarial Networks2019
- On the Reconstruction of Face Images from Deep Face TemplatesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- Synthesizing Normalized Faces from Facial Identity Features2017
- FaceNet: A unified embedding for face recognition and clustering2015
- Masquerade attack on transform-based binary-template protection based on perceptron learningPattern Recognition, 2014
- Reconstructing faces from their signatures using RBF regression2013
- From Scores to Face Templates: A Model-Based ApproachIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Sample images can be independently restored from face recognition templates2004