Towards Real-World Blind Face Restoration with Generative Facial Prior
Authors:
Top Cited Papers
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 9164-9174
Abstract
Blind face restoration usually relies on facial priors, such as facial geometry prior or reference prior, to restore realistic and faithful details. However, very low-quality inputs cannot offer accurate geometric prior while high-quality references are inaccessible, limiting the applicability in real-world scenarios. In this work, we propose GFP-GAN that leverages rich and diverse priors encapsulated in a pretrained face GAN for blind face restoration. This Generative Facial Prior (GFP) is incorporated into the face restoration process via spatial feature transform layers, which allow our method to achieve a good balance of realness and fidelity. Thanks to the powerful generative facial prior and delicate designs, our GFP-GAN could jointly restore facial details and enhance colors with just a single forward pass, while GAN inversion methods require image-specific optimization at inference. Extensive experiments show that our method achieves superior performance to prior art on both synthetic and real-world datasets.Keywords
All Related Versions
This publication has 49 references indexed in Scilit:
- Globally and locally consistent image completionACM Transactions on Graphics, 2017
- NTIRE 2017 Challenge on Single Image Super-Resolution: Methods and Results2017
- Attention-Aware Face Hallucination via Deep Reinforcement Learning2017
- Generative Face Completion2017
- Non-local Color Image Denoising with Convolutional Neural Networks2017
- Image Style Transfer Using Convolutional Neural Networks2016
- Building Dual-Domain Representations for Compression Artifacts Reduction2016
- Deep Residual Learning for Image Recognition2016
- Compression Artifacts Reduction by a Deep Convolutional Network2015
- Deep Learning Face Attributes in the Wild2015