Template Inversion Attack Using Synthetic Face Images Against Real Face Recognition Systems
- 22 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biometrics, Behavior, and Identity Science
- Vol. 6 (3) , 374-384
Abstract
In this paper, we use synthetic data and propose a new method for template inversion attacks against face recognition systems. We use synthetic data to train a face reconstruction model to generate high-resolution (i.e., 1024×1024) face images from facial templates. To this end, we use a face generator network to generate synthetic face images and extract their facial templates using the face recognition model as our training set. Then, we use the synthesized dataset to learn a mapping from facial templates to the intermediate latent space of the same face generator network. We propose our method for both whitebox and blackbox TI attacks. Our experiments show that the trained model with synthetic data can be used to reconstruct face images from templates extracted from real face images. In our experiments, we compare our method with previous methods in the literature in attacks against different state-of-the-art face recognition models on four different face datasets, including the MOBIO, LFW, AgeDB, and IJB-C datasets, demonstrating the effectiveness of our proposed method on real face recognition datasets. Experimental results show our method outperforms previous methods on high-resolution 2D face reconstruction from facial templates and achieve competitive results with SOTA face reconstruction methods. Furthermore, we conduct practical presentation attacks using the generated face images in digital replay attacks against real face recognition systems, showing the vulnerability of face recognition systems to presentation attacks based on our TI attack (with synthetic train data) on real face datasets.Keywords
Funding Information
- H2020 TReSPAsS-ETN Marie Sklodowska-Curie Early Training Network (860813)
This publication has 41 references indexed in Scilit:
- Synthetic data for face recognition: Current state and future prospectsImage and Vision Computing, 2023
- Handbook of Biometric Anti-Spoofing2023
- Reconstruct face from features based on genetic algorithm using GAN generator as a distribution constraintComputers & Security, 2022
- Biometric cryptosystems: a comprehensive surveyMultimedia Tools and Applications, 2022
- Towards Generating High Definition Face Images from Deep Templates2021
- Biometric Template Protection: A Systematic Literature Review of Approaches and Modalities2016
- Session variability modelling for face authenticationIET Biometrics, 2013
- On the vulnerability of face verification systems to hill-climbing attacksPattern Recognition, 2009
- Genetic algorithms: a surveyComputer, 1994
- Simulated annealing1987