Cascade EF-GAN: Progressive Facial Expression Editing With Local Focuses
Authors:
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5020-5029
Abstract
Recent advances in Generative Adversarial Nets (GANs) have shown remarkable improvements for facial expression editing. However, current methods are still prone to generate artifacts and blurs around expression-intensive regions, and often introduce undesired overlapping artifacts while handling large-gap expression transformations such as transformation from furious to laughing. To address these limitations, we propose Cascade Expression Focal GAN (Cascade EF-GAN), a novel network that performs progressive facial expression editing with local expression focuses. The introduction of the local focus enables the Cascade EF-GAN to better preserve identity-related features and details around eyes, noses and mouths, which further helps reduce artifacts and blurs within the generated facial images. In addition, an innovative cascade transformation strategy is designed by dividing a large facial expression transformation into multiple small ones in cascade, which helps suppress overlapping artifacts and produce more realistic editing while dealing with large-gap expression transformations. Extensive experiments over two publicly available facial expression datasets show that our proposed Cascade EF-GAN achieves superior performance for facial expression editing.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the WildIEEE Transactions on Affective Computing, 2017
- Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Peak-Piloted Deep Network for Facial Expression Recognition2016
- Context Encoders: Feature Learning by Inpainting2016
- Compound facial expressions of emotionProceedings of the National Academy of Sciences, 2014
- Presentation and validation of the Radboud Faces DatabaseCognition and Emotion, 2010
- Two Fixations Suffice in Face RecognitionPsychological Science, 2008
- Scope of validity of PSNR in image/video quality assessmentElectronics Letters, 2008
- Eye-movement-based memory effect: A reprocessing effect in face perception.Journal of Experimental Psychology: Learning, Memory, and Cognition, 1999