MichiGAN
Authors:
Open Access
- 12 August 2020
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 39 (4)
Abstract
Despite the recent success of face image generation with GANs, conditional hair editing remains challenging due to the under-explored complexity of its geometry and appearance. In this paper, we present MichiGAN (Multi-Input-Conditioned Hair Image GAN), a novel conditional image generation method for interactive portrait hair manipulation. To provide user control over every major hair visual factor, we explicitly disentangle hair into four orthogonal attributes, including shape, structure, appearance, and background. For each of them, we design a corresponding condition module to represent, process, and convert user inputs, and modulate the image generation pipeline in ways that respect the natures of different visual attributes. All these condition modules are integrated with the backbone generator to form the final end-to-end network, which allows fully-conditioned hair generation from multiple user inputs. Upon it, we also build an interactive portrait hair editing system that enables straightforward manipulation of hair by projecting intuitive and high-level user inputs such as painted masks, guiding strokes, or reference photos to well-defined condition representations. Through extensive experiments and evaluations, we demonstrate the superiority of our method regarding both result quality and user controllability.Keywords
This publication has 34 references indexed in Scilit:
- Hair Interpolation for Portrait MorphingComputer Graphics Forum, 2013
- Structure-aware hair captureACM Transactions on Graphics, 2013
- Dynamic hair manipulation in images and videosACM Transactions on Graphics, 2013
- Single-view hair modeling for portrait manipulationACM Transactions on Graphics, 2012
- Video face replacementACM Transactions on Graphics, 2011
- Expression flow for 3D-aware face component transferACM Transactions on Graphics, 2011
- Personal photo enhancement using example imagesACM Transactions on Graphics, 2010
- Hair photoboothACM Transactions on Graphics, 2008
- Face swappingACM Transactions on Graphics, 2008
- Data-driven enhancement of facial attractivenessACM Transactions on Graphics, 2008