Learning to Super-Resolve Face Images via Dual-Domain Multi-scale Feature Interaction
- 1 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 35, 1
Abstract
Face Super-Resolution (FSR), aiming to improve the quality of Low-Resolution (LR) facial images, has been greatly propelled by the deep learning techniques. However, existing approaches, whether based on Convolutional Neural Networks (CNNs) or Transformers, are either inherently damaging facial structures limited by their architectures or failing to capture essential multi-scale textures due to the rigid receptive fields. To address these concerns, we propose a novel dual-domain feature interaction method called Spatial-frequency Multi-scale feature Learning Network (SMLNet) for FSR by employing a dual-branch architecture. Specifically, the frequency branch captures high-quality global structures and fine high-frequency details, while the spatial branch operates complementarily to preserve fine-grained local texture patterns. Moreover, we further introduce a Multi-scale Spatial-frequency feature Interaction Module (MSIM), which combines a Multi-scale Feature Extraction Block (MFEB) and a Spatial-Frequency feature Interaction Module (SFIM) to interact and aggregate multi-level complementary features from the dual branches. Extensive quantitative experiments and qualitative analyses across multiple datasets, together with evaluations on real-world images, demonstrate that the proposed SMLNet significantly outperforms other state-of-the-art methods.Keywords
Funding Information
- National Natural Science Foundation of China (62071174)
- Basic and Applied Basic Research Foundation of Guangdong Province (2025A1515010293)
This publication has 58 references indexed in Scilit:
- Face Super-Resolution Guided by 3D Facial Priors2020
- Super-Identity Convolutional Neural Network for Face Hallucination2018
- Image Super-Resolution Using Very Deep Residual Channel Attention Networks2018
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- Super-FAN: Integrated Facial Landmark Localization and Super-Resolution of Real-World Low Resolution Faces in Arbitrary Poses with GANs2018
- Ultra-Resolving Face Images by Discriminative Generative Networks2016
- Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network2016
- A novel face-hallucination scheme based on singular value decompositionPattern Recognition, 2013
- Interactive Facial Feature Localization2012
- Hallucinating faces2002