Sniffer: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detection
Authors:
- 16 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 13052-13062
Abstract
Misinformation is a prevalent societal issue due to its potential high risks. Out-Of-Context (OOC) misinformation, where authentic images are repurposed with false text, is one of the easiest and most effective ways to mislead audiences. Current methods focus on assessing image- text consistency but lack convincing explanations for their judgments, which are essential for debunking misinformation. While Multimodal Large Language Models (MLLMs) have rich knowledge and innate capability for visual rea- soning and explanation generation, they still lack sophisti- cation in understanding and discovering the subtle cross- modal differences. In this paper, we introduce Sniffer,a novel multimodal large language model specifically engi- neered for OOC misinformation detection and explanation. Snifferemploys two-stage instruction tuning on Instruct- BLIP. The first stage refines the model's concept alignment of generic objects with news-domain entities and the sec- ond stage leverages OOC-specific instruction data gener- ated by language-only GPT-4 to fine-tune the model's dis- criminatory powers. Enhanced by external tools and re- trieval, Sniffernot only detects inconsistencies between text and image but also utilizes external knowledge for con- textual verification. Our experiments show that Sniffersurpasses the original MLLM by over 40% and outperforms state-of-the-art methods in detection accuracy. Snifferalso provides accurate and persuasive explanations as val- idated by quantitative and human evaluations.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Detecting and Grounding Multi-Modal Media Manipulation2023
- DeepFake Disrupter: The Detector of DeepFake Is My Friend2022
- Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resources2022
- Multimodal news analytics using measures of cross-modal entity and context consistencyInternational Journal of Multimedia Information Retrieval, 2021
- Deepfakes and beyond: A Survey of face manipulation and fake detectionInformation Fusion, 2020
- Exploring the Role of Visual Content in Fake News Detection2020
- $\mathsf {SAFE}$: Similarity-Aware Multi-modal Fake News Detection2020
- Exploiting Multi-domain Visual Information for Fake News Detection2019
- AIRD: Adversarial Learning Framework for Image Repurposing Detection2019
- EANN2018