Shallow- and Deep-fake Image Manipulation Localization Using Vision Mamba and Guided Graph Neural Network
Preprint
Abstract
Image manipulation localization is a critical research task, given that forged images may have a significant societal impact of various aspects. Such image manipulations can be produced using traditional image editing tools (known as "shallowfakes") or advanced artificial intelligence techniques ("deepfakes"). While numerous studies have focused on image manipulation localization on either shallowfake images or deepfake videos, few approaches address both cases. In this paper, we explore the feasibility of using a deep learning network to localize manipulations in both shallow- and deep-fake images, and proposed a solution for such purpose. To precisely differentiate between authentic and manipulated pixels, we leverage the Vision Mamba network to extract feature maps that clearly describe the boundaries between tampered and untouched regions. To further enhance this separation, we propose a novel Guided Graph Neural Network (G-GNN) module that amplifies the distinction between manipulated and authentic pixels. Our evaluation results show that our proposed method achieved higher inference accuracy compared to other state-of-the-art methods.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- MambaIR: A Simple Baseline for Image Restoration with State-Space Model2024
- Learning JPEG Compression Artifacts for Image Manipulation Detection and LocalizationInternational Journal of Computer Vision, 2022
- Class-Wise Dynamic Graph Convolution for Semantic Segmentation2020
- SPAN: Spatial Pyramid Attention Network for Image Manipulation Localization2020
- Unified Perceptual Parsing for Scene Understanding2018
- Learning Rich Features for Image Manipulation Detection2018
- Pyramid Scene Parsing Network2017
- Deep Residual Learning for Image Recognition2016
- CASIA Image Tampering Detection Evaluation Database2013
- Supervised neural networks for the classification of structuresIEEE Transactions on Neural Networks, 1997