Mask-Guided Portrait Editing With Conditional GANs
Authors:
- 1 June 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3431-3440
Abstract
Portrait editing is a popular subject in photo manipulation.The Generative Adversarial Network (GAN) advances the generating of realistic faces and allows more face editing. In this paper, we argue about three issues in existing techniques: diversity, quality, and controllability for portrait synthesis and editing. To address these issues, we propose a novel end-to-end learning framework that leverages conditional GANs guided by provided face masks for generating faces. The framework learns feature embeddings for every face component (e.g., mouth, hair, eye), separately, contributing to better correspondences for image translation, and local face editing. With the mask, our network is available to many applications, like face synthesis driven by mask, face Swap+ (including hair in swapping), and local manipulation. It can also boost the performance of face parsing a bit as an option of data augmentation.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Globally and locally consistent image completionACM Transactions on Graphics, 2017
- Image Style Transfer Using Convolutional Neural Networks2016
- EyeOpenerACM Transactions on Graphics, 2016
- Deep Learning Face Attributes in the Wild2015
- Fully convolutional networks for semantic segmentation2015
- Style transfer for headshot portraitsACM Transactions on Graphics, 2014
- Joint Cascade Face Detection and Alignment2014
- Exemplar-Based Face Parsing2013
- Face swappingACM Transactions on Graphics, 2008
- Photo clip artACM Transactions on Graphics, 2007