DF-Platter: Multi-Face Heterogeneous Deepfake Dataset
Authors:
- 1 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 9739-9748
Abstract
Deepfake detection is gaining significant importance in the research community. While most of the research efforts are focused towards high-quality images and videos with controlled appearance of individuals, deepfake generation algorithms now have the capability to generate deep-fakes with low-resolution, occlusion, and manipulation of multiple subjects. In this research, we emulate the real-world scenario of deepfake generation and propose the DF-Platter dataset, which contains (i) both low-resolution and high-resolution deepfakes generated using multiple generation techniques and (ii) single-subject and multiple-subject deepfakes, with face images of Indian ethnicity. Faces in the dataset are annotated for various attributes such as gender, age, skin tone, and occlusion. The dataset is prepared in 116 days with continuous usage of 32 GPUs accounting to 1,800 GB cumulative memory. With over 500 GBs in size, the dataset contains a total of 133,260 videos encompassing three sets. To the best of our knowledge, this is one of the largest datasets containing vast variability and multiple challenges. We also provide benchmark results under multiple evaluation settings using popular and state-of-the-art deepfake detection models, for c0 images and videos along with c23 and c40 compression variants. The results demonstrate a significant performance reduction in the deepfake detection task on low-resolution deep-fakes. Furthermore, existing techniques yield declined detection accuracy on multiple-subject deepfakes. It is our assertion that this database will improve the state-of-the-art by extending the capabilities of deepfake detection algorithms to real-world scenarios. The database is available at: http://iab-rubric.org/df-platter-database.Keywords
This publication has 18 references indexed in Scilit:
- WildDeepfake2020
- DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection2020
- DeepFake Detection by Analyzing Convolutional Traces2020
- FaceForensics++: Learning to Detect Manipulated Facial Images2019
- FSGAN: Subject Agnostic Face Swapping and Reenactment2019
- DSFD: Dual Shot Face Detector2019
- MesoNet: a Compact Facial Video Forgery Detection Network2018
- Xception: Deep Learning with Depthwise Separable Convolutions2017
- Deep Residual Learning for Image Recognition2016
- No-Reference Image Quality Assessment in the Spatial DomainIEEE Transactions on Image Processing, 2012