Learning Rich Features for Image Manipulation Detection
Authors:
- Peng ZhouPZPeng Zhou
- Xintong HanXHXintong Han
- Vlad I. MorariuVMVlad I. Morariu
- Larry S. DavisLDLarry S. Davis
Top Cited Papers
- 1 June 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1053-1061
Abstract
Image manipulation detection is different from traditional semantic object detection because it pays more attention to tampering artifacts than to image content, which suggests that richer features need to be learned. We propose a two-stream Faster R-CNN network and train it end-to-end to detect the tampered regions given a manipulated image. One of the two streams is an RGB stream whose purpose is to extract features from the RGB image input to find tampering artifacts like strong contrast difference, unnatural tampered boundaries, and so on. The other is a noise stream that leverages the noise features extracted from a steganalysis rich model filter layer to discover the noise inconsistency between authentic and tampered regions. We then fuse features from the two streams through a bilinear pooling layer to further incorporate spatial co-occurrence of these two modalities. Experiments on four standard image manipulation datasets demonstrate that our two-stream framework outperforms each individual stream, and also achieves state-of-the-art performance compared to alternative methods with robustness to resizing and compression.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Large-scale evaluation of splicing localization algorithms for web imagesMultimedia Tools and Applications, 2016
- A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer2016
- Compact Bilinear Pooling2016
- Bilinear CNN Models for Fine-Grained Visual Recognition2015
- Fast R-CNN2015
- Splicebuster: A new blind image splicing detector2015
- Median Filtering Forensics Based on Convolutional Neural NetworksIEEE Signal Processing Letters, 2015
- CASIA Image Tampering Detection Evaluation Database2013
- Rich Models for Steganalysis of Digital ImagesIEEE Transactions on Information Forensics and Security, 2012
- Using noise inconsistencies for blind image forensicsImage and Vision Computing, 2009