DeepFake Disrupter: The Detector of DeepFake Is My Friend
Authors:
- 1 June 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 14900-14909
Abstract
In recent years, with the advances of generative models, many powerful face manipulation systems have been developed based on Deep Neural Networks (DNNs), called DeepFakes. If DeepFakes are not controlled timely and properly, they would become a real threat to both celebrities and ordinary people. Precautions such as adding perturbations to the source inputs will make DeepFake results look distorted from the perspective of human eyes. However, previous method doesn't explore whether the disrupted images can still spoof DeepFake detectors. This is critical for many applications where DeepFake detectors are used to discriminate between DeepFake data and real data due to the huge cost of examining a large amount of data manually. We argue that the detectors do not share a similar perspective as human eyes, which might still be spoofed by the disrupted data. Besides, the existing disruption methods rely on iteration-based perturbation generation algorithms, which is time-consuming. In this paper, we propose a novel DeepFake disruption algorithm called “DeepFake Disrupter”. By training a perturbation generator, we can add the human-imperceptible perturbations to source images that need to be protected without any backpropagation update. The DeepFake results of these protected source inputs would not only look unrealistic by the human eye but also can be distinguished by DeepFake detectors easily. For example, experimental results show that by adding our trained perturbations, fake images generated by StarGAN [5] can result in a 10 ∼ 20% increase in F1-score evaluated by various DeepFake detectors.Keywords
Funding Information
- Australian Research Council (DP210101859)
This publication has 23 references indexed in Scilit:
- GANimation: Anatomically-Aware Facial Animation from a Single Image2018
- Recycle-GAN: Unsupervised Video Retargeting2018
- RSGAN2018
- StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation2018
- Generative Adversarial Perturbations2018
- Fast Face-Swap Using Convolutional Neural Networks2017
- VoxCeleb: A Large-Scale Speaker Identification Dataset2017
- Synthesizing ObamaACM Transactions on Graphics, 2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Deep Learning Face Attributes in the Wild2015