Pu Sun
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Pu Sun has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Siwei Lyu
University at Buffalo, SUNY, USA
3 shared publications - Yuezun Li
School of Computer Science and Technology, Ocean University of China, Qingdao, China
3 shared publications - Honggang Qi
University of Chinese Academy of Sciences, Beijing, China
2 shared publications Honggang Qi
1 shared publicationJunyu Dong
1 shared publication- Ming-Ching Chang
University at Albany
1 shared publication
Latest Publications
- 16 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computing
- Vol. 13 (1) , 134-146
FakeTracer: Catching Face-Swap DeepFakes via Implanting Traces in Training
Face-swap DeepFake is an emerging AI-based face forgery technique that can replace the original face in a video with a generated face of the target identity while retaining consistent facial attributes such as expression and orientation. Due to the high privacy of faces, the misuse of this technique can raise severe social concerns, drawing tremendous attention to defend against DeepFakes recently. In this paper, we describe a new proactive defense method called FakeTracer to expose face-swap DeepFakes via implanting traces in training. Compared to general face-synthesis DeepFake, the face-swap DeepFake is more complex as it involves identity change, is subjected to the encoding-decoding process, and is trained unsupervised, increasing the difficulty of implanting traces into the training phase. To effectively defend against face-swap DeepFake, we design two types of traces, sustainable trace (STrace) and erasable trace (ETrace), to be added to training faces. During the training, these manipulated faces affect the learning of the face-swap DeepFake model, enabling it to generate faces that only contain sustainable traces. In light of these two traces, our method can effectively expose DeepFakes by identifying them. Extensive experiments corroborate the efficacy of our method on defending against face-swap DeepFake.
- 16 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computing
- Vol. 13 (1) , 134-146
FakeTracer: Catching Face-Swap DeepFakes via Implanting Traces in Training
Face-swap DeepFake is an emerging AI-based face forgery technique that can replace the original face in a video with a generated face of the target identity while retaining consistent facial attributes such as expression and orientation. Due to the high privacy of faces, the misuse of this technique can raise severe social concerns, drawing tremendous attention to defend against DeepFakes recently. In this paper, we describe a new proactive defense method called FakeTracer to expose face-swap DeepFakes via implanting traces in training. Compared to general face-synthesis DeepFake, the face-swap DeepFake is more complex as it involves identity change, is subjected to the encoding-decoding process, and is trained unsupervised, increasing the difficulty of implanting traces into the training phase. To effectively defend against face-swap DeepFake, we design two types of traces, sustainable trace (STrace) and erasable trace (ETrace), to be added to training faces. During the training, these manipulated faces affect the learning of the face-swap DeepFake model, enabling it to generate faces that only contain sustainable traces. In light of these two traces, our method can effectively expose DeepFakes by identifying them. Extensive experiments corroborate the efficacy of our method on defending against face-swap DeepFake.
- 22 July 2022
- Published by Elsevier in Pattern Recognition Letters
- Vol. 161, 90-98
LandmarkGAN: Synthesizing faces from landmarks
- 22 July 2022
- Published by Elsevier in Pattern Recognition Letters
- Vol. 161, 90-98
LandmarkGAN: Synthesizing faces from landmarks
- 1 December 2021
- Published by Elsevier in Computer Vision and Image Understanding
- Vol. 213
TransRPN: Towards the Transferable Adversarial Perturbations using Region Proposal Networks and Beyond
- 1 December 2021
- Published by Elsevier in Computer Vision and Image Understanding
- Vol. 213
TransRPN: Towards the Transferable Adversarial Perturbations using Region Proposal Networks and Beyond