Emotional facial expression transfer from a single image via generative adversarial nets
- 2 May 2018
- journal article
- conference paper
- Published by Wiley in Computer Animation and Virtual Worlds
- Vol. 29 (3-4)
Abstract
Facial expression transfer from a single image is a challenging task and has drawn sustained attention in the fields of computer vision and computer graphics. Recently, generative adversarial nets (GANs) have provided a new approach to facial expression transfer from a single image toward target facial expressions. However, it is still difficult to obtain a sequence of smoothly changed facial expressions. We present a novel GAN‐based method for generating emotional facial expression animations given a single image and several facial landmarks for the in‐between stages. In particular, landmarks of other subjects are incorporated into a GAN model to control the generated facial expression from a latent space. With the trained model, high‐quality face images and a smoothly changed facial expression sequence can be effectively obtained, which are showed qualitatively and quantitatively in our experiments on the Multi‐PIE and CK+ data sets.Keywords
Funding Information
- National Natural Science Foundation of China (61661146002)
This publication has 19 references indexed in Scilit:
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Displaced dynamic expression regression for real-time facial tracking and animationACM Transactions on Graphics, 2014
- One millisecond face alignment with an ensemble of regression trees2014
- Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector MachinesSensors, 2013
- Multi-PIEImage and Vision Computing, 2010
- Visio-lizationACM Transactions on Graphics, 2009
- Facial animation by optimized blendshapes from motion capture dataComputer Animation and Virtual Worlds, 2008
- Active Appearance Models RevisitedInternational Journal of Computer Vision, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Reanimating Faces in Images and VideoComputer Graphics Forum, 2003