Wentang Song
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Wentang Song has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Bin Li
Shenzhen University, Shenzhen, Guangdong, China
2 shared publications - Han Chen
Shenzhen University
2 shared publications - Jiangqun Ni
School of Cyber Science and Technology, Sun Yat-sen University, Shenzhen, China and Department of New Networks, Peng Cheng Laboratory, Shenzhen, China
2 shared publications - Qiushi Li
Media Integration and Communication Center (MICC), University of Florence, Florence, Italy
2 shared publications - Yuezun Li
School of Computer Science and Technology, Ocean University of China, Qingdao, China
2 shared publications - Yuzhen Lin
Shenzhen University
2 shared publications
Latest Publications
- 26 October 2024
- Published by Springer Nature
- p. 104-122
Fake It till You Make It: Curricular Dynamic Forgery Augmentations Towards General Deepfake Detection
- 26 October 2024
- Published by Springer Nature
- p. 104-122
Fake It till You Make It: Curricular Dynamic Forgery Augmentations Towards General Deepfake Detection
- Open Access
Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detection
Previous studies in deepfake detection have shown promising results when testing face forgeries from the same dataset as the training. However, the problem remains challenging when one tries to generalize the detector to forgeries from unseen datasets and created by unseen methods. In this work, we present a novel general deepfake detection method, called \textbf{C}urricular \textbf{D}ynamic \textbf{F}orgery \textbf{A}ugmentation (CDFA), which jointly trains a deepfake detector with a forgery augmentation policy network. Unlike the previous works, we propose to progressively apply forgery augmentations following a monotonic curriculum during the training. We further propose a dynamic forgery searching strategy to select one suitable forgery augmentation operation for each image varying between training stages, producing a forgery augmentation policy optimized for better generalization. In addition, we propose a novel forgery augmentation named self-shifted blending image to simply imitate the temporal inconsistency of deepfake generation. Comprehensive experiments show that CDFA can significantly improve both cross-datasets and cross-manipulations performances of various naive deepfake detectors in a plug-and-play way, and make them attain superior performances over the existing methods in several benchmark datasets.
Open AccessFake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detection
Previous studies in deepfake detection have shown promising results when testing face forgeries from the same dataset as the training. However, the problem remains challenging when one tries to generalize the detector to forgeries from unseen datasets and created by unseen methods. In this work, we present a novel general deepfake detection method, called \textbf{C}urricular \textbf{D}ynamic \textbf{F}orgery \textbf{A}ugmentation (CDFA), which jointly trains a deepfake detector with a forgery augmentation policy network. Unlike the previous works, we propose to progressively apply forgery augmentations following a monotonic curriculum during the training. We further propose a dynamic forgery searching strategy to select one suitable forgery augmentation operation for each image varying between training stages, producing a forgery augmentation policy optimized for better generalization. In addition, we propose a novel forgery augmentation named self-shifted blending image to simply imitate the temporal inconsistency of deepfake generation. Comprehensive experiments show that CDFA can significantly improve both cross-datasets and cross-manipulations performances of various naive deepfake detectors in a plug-and-play way, and make them attain superior performances over the existing methods in several benchmark datasets.