An integrated spatiotemporal-based methodology for deepfake detection
Open Access
- 2 August 2022
- journal article
- research article
- Published by Springer Nature in Neural Computing and Applications
- Vol. 34 (24) , 21777-21791
Abstract
Rapid advances in deep learning models have made it easier for public and crackers to generate hyper-realistic deepfake videos in which faces are swapped. Such deepfake videos may constitute a significant threat to the world if they are misused to blackmail public figures and to deceive systems of face recognition. As a result, distinguishing these fake videos from real ones has become fundamental. This paper introduces a new deepfake video detection method. You Only Look Once (YOLO) face detector is used to detect faces from video frames. A proposed hybrid method based on proposing two different feature extraction methods is applied to these faces. The first feature extraction method, a proposed Convolution Neural Network (CNN), is based on the Histogram of Oriented Gradient (HOG) method. The second one is an ameliorated XceptionNet CNN. The two extracted sets of features are merged together and fed as input to a sequence of Gated Recurrent Units (GRUs) to extract the spatial and temporal features and then individuate the authenticity of videos. The proposed method is trained on the CelebDF-FaceForencics++ (c23) dataset and evaluated on the CelebDF test set. The experimental results and analysis confirm the superiority of the suggested method over the state-of-the-art methods.Keywords
Funding Information
- Tanta University
This publication has 45 references indexed in Scilit:
- Shallow Convolutional Neural Networks for Acoustic Scene ClassificationWuhan University Journal of Natural Sciences, 2018
- Synthesizing ObamaACM Transactions on Graphics, 2017
- Xception: Deep Learning with Depthwise Separable Convolutions2017
- Face2Face: Real-Time Face Capture and Reenactment of RGB Videos2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Facial expression recognition and histograms of oriented gradients: a comprehensive studySpringerPlus, 2015
- Convolutional neural networks at constrained time cost2015
- Tucker decomposition-based tensor learning for human action recognitionMultimedia Systems, 2015
- HOG based fast human detection2012
- Video forgery detection using HOG features and compression properties2012