VideoForensicsHQ: Detecting High-quality Manipulated Face Videos
Preprint
Abstract
New approaches to synthesize and manipulate face videos at very high quality have paved the way for new applications in computer animation, virtual and augmented reality, or face video analysis. However, there are concerns that they may be used in a malicious way, e.g. to manipulate videos of public figures, politicians or reporters, to spread false information. The research community therefore developed techniques for automated detection of modified imagery, and assembled benchmark datasets showing manipulatons by state-of-the-art techniques. In this paper, we contribute to this initiative in two ways: First, we present a new audio-visual benchmark dataset. It shows some of the highest quality visual manipulations available today. Human observers find them significantly harder to identify as forged than videos from other benchmarks. Furthermore we propose new family of deep-learning-based fake detectors, demonstrating that existing detectors are not well-suited for detecting fakes of a quality as high as presented in our dataset. Our detectors examine spatial and temporal features. This allows them to outperform existing approaches both in terms of high detection accuracy and generalization to unseen fake generation methods and unseen identities.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Deepfakes and beyond: A Survey of face manipulation and fake detectionInformation Fusion, 2020
- CNN-Generated Images Are Surprisingly Easy to Spot… for Now2020
- Localization of Deep Inpainting Using High-Pass Fully Convolutional Network2019
- FaceForensics++: Learning to Detect Manipulated Facial Images2019
- Detecting Photoshopped Faces by Scripting Photoshop2019
- Few-Shot Adversarial Learning of Realistic Neural Talking Head Models2019
- ManTra-Net: Manipulation Tracing Network for Detection and Localization of Image Forgeries With Anomalous Features2019
- Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos2019
- Learning Rich Features for Image Manipulation Detection2018
- Deformable Model Fitting by Regularized Landmark Mean-ShiftInternational Journal of Computer Vision, 2010