FaceReclaim: Deep Traceability of Face-Swapped Images Through Feature Decoupling
- 18 May 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Forensics and Security
- Vol. 21 (15566013) , 5748-5762
Abstract
Face-swapping Deepfake technology enables the replacement of one person’s face with another while preserving the facial attributes (e.g., expressions and postures) of the original person being replaced. Although it has various applications, its misuse raises significant security concerns. In recent years, numerous Deepfake forensic techniques have been proposed, relying on binary classification models to detect the authenticity of facial images. However, another important issue, the feasibility of tracing the original face replaced in the deepfake process, has received little attention, as it intuitively seems impossible. In this work, we consider the problem known as the Traceability of Face-swapping Deepfake (TFD). Unlike existing deepfake detection tasks, TFD focuses on restoring the original faces lost in the face-swapping process. Specifically, we reformulate TFD as a specialized image-to-image editing problem and propose a novel diffusion-based framework named FaceReclaim for TFD. To ensure effective traceability, we develop a Multi-Scale Face Attribute Decoupling (FAD) and a Multi-Modal Face Identity Prompting (FIP) for dual-conditioning guidance. FAD extracts multi-scale attribute information decoupled from the synthetic face-swapped images, providing positive guidance to preserve essential attribute features during restoration. FIP integrates both textual and visual instructions, serving as negative guidance to explicitly direct the model in erasing identity traces of the face-swapped image. Our research shows that the synthetic face still retains subtle, traceable features of the original face, enabling its approximation and restoration. We evaluate our model from both visual restoration performance and the face verification perspective. Extensive experiments demonstrate the qualitative and quantitative effectiveness of our scheme.Keywords
Funding Information
- National Natural Science Foundation of China (62571338)
- Basic and Applied Basic Research Foundation of Guangdong Province (2025A1515010954)
- Guangdong Provincial Key Laboratory (2023B1212060076)
- China Computer Federation (CCF)-Huawei Populus Grove (CCF-HuaweiTC202508)
- Sichuan Science and Technology Program (2026NSFSC1461)
- Ganpo Talent Program of Jiangxi Province (gpyc20240012)
- Outstanding Youth Fund Program of Jiangxi Province (20252BAC220008)
- Jiangxi Key Research and Development Program (20261BCE310050)
This publication has 40 references indexed in Scilit:
- DiffFace: Diffusion-based face swapping with facial guidancePattern Recognition, 2025
- A Diffusion-Based Approach for Restoring Face-swapped Images2024
- Designing One Unified Framework for High-Fidelity Face Reenactment and Swapping2022
- One Shot Face Swapping on Megapixels2021
- Information Bottleneck Disentanglement for Identity Swapping2021
- Advancing High Fidelity Identity Swapping for Forgery Detection2020
- ArcFace: Additive Angular Margin Loss for Deep Face Recognition2019
- A Style-Based Generator Architecture for Generative Adversarial Networks2019
- FaceNet: A unified embedding for face recognition and clustering2015
- DeepFace: Closing the Gap to Human-Level Performance in Face Verification2014