Can deepfakes be created by novice users?
Authors:
Preprint
Abstract
Recent advancements in machine learning and computer vision have led to the proliferation of Deepfakes. As technology democratizes over time, there is an increasing fear that novice users can create Deepfakes, to discredit others and undermine public discourse. In this paper, we conduct user studies to understand whether participants with advanced computer skills and varying levels of computer science expertise can create Deepfakes of a person saying a target statement using limited media files. We conduct two studies; in the first study (n = 39) participants try creating a target Deepfake in a constrained time frame using any tool they desire. In the second study (n = 29) participants use pre-specified deep learning-based tools to create the same Deepfake. We find that for the first study, 23.1% of the participants successfully created complete Deepfakes with audio and video, whereas, for the second user study, 58.6% of the participants were successful in stitching target speech to the target video. We further use Deepfake detection software tools as well as human examiner-based analysis, to classify the successfully generated Deepfake outputs as fake, suspicious, or real. The software detector classified 80% of the Deepfakes as fake, whereas the human examiners classified 100% of the videos as fake. We conclude that creating Deepfakes is a simple enough task for a novice user given adequate tools and time; however, the resulting Deepfakes are not sufficiently real-looking and are unable to completely fool detection software as well as human examinersKeywords
All Related Versions
- Version 1, 2023-04-28, ArXiv
- Published version: , 1324.
This publication has 8 references indexed in Scilit:
- Deepfake detection by human crowds, machines, and machine-informed crowdsProceedings of the National Academy of Sciences, 2021
- A Review on Generative Adversarial Networks: Algorithms, Theory, and ApplicationsIEEE Transactions on Knowledge and Data Engineering, 2021
- Dispelling Misconceptions and Characterizing the Failings of Deepfake DetectionIEEE Security & Privacy, 2021
- Deepfakes and beyond: A Survey of face manipulation and fake detectionInformation Fusion, 2020
- Do (Microtargeted) Deepfakes Have Real Effects on Political Attitudes?The International Journal of Press/Politics, 2020
- Deepfakes and Disinformation: Exploring the Impact of Synthetic Political Video on Deception, Uncertainty, and Trust in NewsSocial Media + Society, 2020
- Joint Face Detection and Alignment Using Multitask Cascaded Convolutional NetworksIEEE Signal Processing Letters, 2016
- Forged Authenticity: Governing Deepfake Risks