CNN-Transformer Based Generative Adversarial Network for Copy-Move Source/ Target Distinguishment
- 7 November 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 33 (5) , 2019-2032
Abstract
Copy-move forgery can be used for hiding certain objects or duplicating meaningful objects in images. Although copy-move forgery detection has been studied extensively in recent years, it is still a challenging task to distinguish between the source and the target regions in copy-move forgery images. In this paper, a convolutional neural network-transformer based generative adversarial network (CNN-T GAN) is proposed to distinguish the source and target regions in a copy-move forged image. A generator is first utilized to generate a mask that is similar to the groundtruth mask. Then, a discriminator is trained to discriminate the true image pairs from the false ones. When the discriminator cannot discriminate the true/false image pairs accurately, the generator can be used to obtain the final localization maps of copy-move forgery. In the generator, convolutional neural network (CNN) and transformer are exploited to extract the local features and global representations in copy-move forgery images, respectively. In addition, feature coupling layers are designed to integrate the features in CNN branch and transformer branch in an interactive way. Finally, a new Pearson correlation layer is introduced to match the similarity features in source and target regions, which can improve the performance of copy-move forgery localization, especially the localization performance on source regions. To the best of our knowledge, this is the first work to utilize transformer for feature extraction in copy-move forgery localization. The proposed method can not only detect the copy-move regions, but also distinguish the source and target regions. Extensive experimental results on several commonly used copy-move datasets have shown that the proposed method outperforms the state-of-the-art methods for copy-move detection.Keywords
Funding Information
- National Key Research and Development Program of China (2022YFB3102900)
- National Natural Science Foundation of China (62172402, 62033005, 62172435, U1804263, 61872350)
- Zhongyuan Science and Technology Innovation Leading Talent Project (214200510019)
- Science and Technology Development Fund, Macau (0049/2022/A1)
- University of Macau (MYRG2022-00072-FST)
- Fundamental Research Funds for the Central Universities (FRFCU5710011322)
This publication has 36 references indexed in Scilit:
- A Fast Forgery Detection Algorithm Based on Exponential-Fourier Moments for Video Region DuplicationIEEE Transactions on Multimedia, 2017
- Residual Attention Network for Image Classification2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- A copy-move forgery detection method based on CMFD-SIFTMultimedia Tools and Applications, 2017
- Detection of Copy-Move Forgery in Images Using Segmentation and SURF2015
- Efficient Dense-Field Copy–Move Forgery DetectionIEEE Transactions on Information Forensics and Security, 2015
- Going deeper with convolutions2015
- Image Forgery Detection Using Adaptive Oversegmentation and Feature Point MatchingIEEE Transactions on Information Forensics and Security, 2015
- Segmentation-Based Image Copy-Move Forgery Detection SchemeIEEE Transactions on Information Forensics and Security, 2014
- Exploring Duplicated Regions in Natural ImagesIEEE Transactions on Image Processing, 2010