Rank-based No-reference Quality Assessment for Face Swapping
- 5 June 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. PP (10518215) , 1
Abstract
Face swapping has emerged as a significant research area in generative models due to rapid technological advancements. Current image quality assessment metrics for face swapping images depend on comparing facial attributes between fake and real images (e.g., target faces and source faces). However, obtaining such corresponding real images is often impractical. To address this challenge, we propose a no-reference image quality assessment method for face swapping. We observed that consistency among errors in various facial attributes can indicate overall image quality. Based on this insight, we created a large-scale face swapping dataset with multi-attribute ranking labels to produce quality ranking labels for objective attribute errors. We then trained a Siamese network to learn consistency patterns among these errors, demonstrating through experiments that these patterns align with human subjective judgments. Our method achieved state-of-the-art results in both coarse- and fine-grained tests. Finally, we applied this as a loss function to enhance existing face swapping models, leading to improvements in expression and pose attributes. Extensive experiments confirm the superiority of our method over existing general no-reference image quality assessment metrics and the latest metric for facial image quality assessment, making it well-suited for evaluating face swapping images in real-world scenarios.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62372423)
- National Natural Science Foundation of China (62121002)
- National Natural Science Foundation of China (62072421)
This publication has 75 references indexed in Scilit:
- Realistic One-Shot Mesh-Based Head Avatars2022
- Towards Metrical Reconstruction of Human Faces2022
- Designing One Unified Framework for High-Fidelity Face Reenactment and Swapping2022
- StyleSwap: Style-Based Generator Empowers Robust Face Swapping2022
- GIQA: Generated Image Quality Assessment2020
- Towards Fast, Accurate and Stable 3D Dense Face Alignment2020
- Semantic Image Synthesis With Spatially-Adaptive Normalization2019
- CosFace: Large Margin Cosine Loss for Deep Face Recognition2018
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- FaceNet: A unified embedding for face recognition and clustering2015