Explainable Thermal to Visible Face Recognition Using Latent-Guided Generative Adversarial Network
Authors:
- 15 December 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
One of the main challenges in performing thermal-to-visible face image translation is preserving the identity across different spectral bands. Existing work does not effectively disentangle the identity from other confounding factors. In this paper, we propose a Latent-Guided Generative Adversarial Network (LG-GAN) to explicitly decompose an input image into identity code that is spectral-invariant and style code that is spectral-dependent. By using such a disentanglement, we are able to analyze the identity preservation by interpreting and visualizing the identity code. We present extensive face recognition experiments on two challenging Visible-Thermal face datasets. We show that the learned identity code is effective in preserving the identity, thus offering useful insights on interpreting and explaining thermal-to-visible face image translation.Keywords
This publication has 14 references indexed in Scilit:
- Coupled generative adversarial network for heterogeneous face recognitionImage and Vision Computing, 2020
- ArcFace: Additive Angular Margin Loss for Deep Face Recognition2019
- Synthesis of High-Quality Visible Faces from Polarimetric Thermal Faces using Generative Adversarial NetworksInternational Journal of Computer Vision, 2019
- Polarimetric Thermal to Visible Face Verification via Attribute Preserved Synthesis2018
- Thermal to Visible Facial Image Translation Using Generative Adversarial NetworksIEEE Signal Processing Letters, 2018
- TV-GAN: Generative Adversarial Network Based Thermal to Visible Face Recognition2018
- Generative adversarial network-based synthesis of visible faces from polarimetrie thermal faces2017
- Heterogeneous Face Recognition: Recent Advances in Infrared-to-Visible Matching2017
- A Polarimetric Thermal Database for Face Recognition Research2016
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004