Closely-Coupled Reconstruction and Generation for Blind Face Restoration
- 12 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 28 (15209210) , 2758-2771
Abstract
Blind Face Restoration (BFR) involves restoring high-quality images from various unknown and severely degraded counterparts, which is a challenging task due to the conflicting objectives of content reconstruction and detail generation. In this paper, we propose a closely-coupled approach to address this problem and achieve photorealistic and faithful reproductions. Specifically, we propose a two-step image restoration model that consists of the following steps: Firstly, we train a BaseNet that incorporates a filtered feature fusion module ($F^{3}M$) to purify degraded feature maps. Secondly, while keeping the BaseNet fixed, we train a DetailNet that utilizes a feature probabilistic model to generate high-frequency detail information. The proposed framework not only separates the reconstruction and generation processes but also deeply analyzes their interactions, leading to an optimized balance between perceptual quality and fidelity. Our approach is validated through extensive experiments on both synthetic datasets and real-world facial photographs, demonstrating significant improvements in Frechet Inception Distance (FID) scores while maintaining identity consistency. The experimental results highlight our method's state-of-the-art performance, achieving superior visual quality and processing efficiency compared to existing methods.Keywords
This publication has 46 references indexed in Scilit:
- VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder2022
- SRDiff: Single image super-resolution with diffusion probabilistic modelsNeurocomputing, 2022
- Blind Face Restoration via Deep Multi-scale Component Dictionaries2020
- Face Super-Resolution Guided by 3D Facial Priors2020
- ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks2019
- Learning Warped Guidance for Blind Face Restoration2018
- Face Super-Resolution Guided by Facial Component Heatmaps2018
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors2018
- Statistical and Computational Inverse Problems2005