Generative adversarial network-based synthesis of visible faces from polarimetrie thermal faces
Authors:
- 1 October 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 100-107
Abstract
The large domain discrepancy between faces captured in polarimetric (or conventional) thermal and visible domain makes cross-domain face recognition quite a challenging problem for both human-examiners and computer vision algorithms. Previous approaches utilize a two-step procedure (visible feature estimation and visible image reconstruction) to synthesize the visible image given the corresponding polarimetric thermal image. However, these are regarded as two disjoint steps and hence may hinder the performance of visible face reconstruction. We argue that joint optimization would be a better way to reconstruct more photo-realistic images for both computer vision algorithms and human-examiners to examine. To this end, this paper proposes a Generative Adversarial Network-based Visible Face Synthesis (GAN-VFS) method to synthesize more photo-realistic visible face images from their corresponding polarimetric images. To ensure that the encoded visible-features contain more semantically meaningful information in reconstructing the visible face image, a guidance sub-network is involved into the training procedure. To achieve photo realistic property while preserving discriminative characteristics for the reconstructed outputs, an identity loss combined with the perceptual loss are optimized in the framework. Multiple experiments evaluated on different experimental protocols demonstrate that the proposed method achieves state-of-the-art performance.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- A Discriminative Feature Learning Approach for Deep Face Recognition2016
- Estimation of visible spectrum faces from polarimetric thermal faces2016
- Context Encoders: Feature Learning by Inpainting2016
- A Polarimetric Thermal Database for Face Recognition Research2016
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification2015
- Holistically-Nested Edge Detection2015
- FaceNet: A unified embedding for face recognition and clustering2015
- Understanding deep image representations by inverting them2015
- Improving cross-modal face recognition using polarimetric imagingOptics Letters, 2015
- Heterogeneous Face Recognition: Matching NIR to Visible Light Images2010