ZeroFake: Zero-Shot Detection of Fake Images Generated and Edited by Text-to-Image Generation Models
Open Access
- 2 December 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 4852-4866
Abstract
The text-to-image generation model has attracted significant interest from both academic and industrial communities. These models can generate the images based on the given prompt descriptions. Their potent capabilities, while beneficial, also present risks. Previous efforts relied on the approach of training binary classifiers to detect the generated fake images, which is inefficient, lacking in generalizability, and non-robust. In this paper, we propose the novel zero-shot detection method, called ZeroFake, to distinguish fake images apart from real ones by utilizing a perturbation-based DDIM inversion technique. ZeroFake is inspired by the findings that fake images are more robust than real images during the process of DDIM inversion and reconstruction. Specifically, for a given image, ZeroFake first generates noise with DDIM inversion guided by adversary prompts. Then, ZeroFake reconstructs the image from the generated noise. Subsequently, it compares the reconstructed image with the original image to determine whether it is fake or real. By exploiting the differential response of fake and real images to the adversary prompts during the inversion and reconstruction process, our model offers a more robust and efficient method to detect fake images without the extensive data and training costs. Extensive results demonstrate that the proposed ZeroFake can achieve great performance in fake image detection, fake artwork detection, and fake edited image detection. We further illustrate the robustness of the proposed ZeroFake by showcasing its resilience against potential adversary attacks. We hope that our solution can better assist the community in achieving the arrival of a more efficient and fair AGI.Keywords
Funding Information
- BMBF (16KISAO29K)
- European Health and Digital Executive Agency (101057917)
This publication has 28 references indexed in Scilit:
- InstructPix2Pix: Learning to Follow Image Editing Instructions2023
- Palette: Image-to-Image Diffusion Models2022
- Text to Image Synthesis With Bidirectional Generative Adversarial Network2020
- CNN-Generated Images Are Surprisingly Easy to Spot… for Now2020
- Diverse Image Synthesis From Semantic Layouts via Conditional IMLE2019
- Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints2019
- Object-Driven Text-To-Image Synthesis via Adversarial Training2019
- Learning to See in the Dark2018
- Detection of GAN-Generated Fake Images over Social Networks2018
- StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks2017