Large-pose facial makeup transfer based on generative adversarial network combined face alignment and face parsing
Authors:
Open Access
- 1 January 2022
- journal article
- research article
- Published by American Institute of Mathematical Sciences (AIMS) in Mathematical Biosciences and Engineering
- Vol. 20 (1) , 737-757
Abstract
Facial makeup transfer is a special form of image style transfer. For the reference makeup image with large-pose, improving the quality of the image generated after makeup transfer is still a challenging problem worthy of discussion. In this paper, a large-pose makeup transfer algorithm based on generative adversarial network (GAN) is proposed. First, a face alignment module (FAM) is introduced to locate the key points, such as the eyes, mouth and skin. Secondly, a face parsing module (FPM) and face parsing losses are designed to analyze the source image and extract the face features. Then, the makeup style code is extracted from the reference image and the makeup transfer is completed through integrating facial features and makeup style code. Finally, a large-pose makeup transfer (LPMT) dataset is collected and constructed. Experiments are carried out on the traditional makeup transfer (MT) dataset and the new LPMT dataset. The results show that the image quality generated by the proposed method is better than that of the latest method for large-pose makeup transfer.Keywords
This publication has 28 references indexed in Scilit:
- BeautyGAN2018
- BiSeNet: Bilateral Segmentation Network for Real-Time Semantic Segmentation2018
- Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization2017
- Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017
- Perceptual Losses for Real-Time Style Transfer and Super-Resolution2016
- Joint Face Detection and Alignment Using Multitask Cascaded Convolutional NetworksIEEE Signal Processing Letters, 2016
- Deep Residual Learning for Image Recognition2016
- Simulating makeup through physics-based manipulation of intrinsic image layers2015
- An automatic framework for example-based virtual makeup2013
- Example-Based Cosmetic Transfer2007