GAMED: Knowledge Adaptive Multi-Experts Decoupling for Multimodal Fake News Detection
Open Access
- 10 March 2025
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 586-595
Abstract
Multimodal fake news detection often involves modelling heterogeneous data sources, such as vision and language. Existing detection methods typically rely on fusion effectiveness and cross-modal consistency to model the content, complicating understanding how each modality affects prediction accuracy. Additionally, these methods are primarily based on static feature modelling, making it difficult to adapt to the dynamic changes and relationships between different data modalities. This paper develops a significantly novel approach, GAMED, for multimodal modelling, which focuses on generating distinctive and discriminative features through modal decoupling to enhance cross-modal synergies, thereby optimizing overall performance in the detection process. GAMED leverages multiple parallel expert networks to refine features and pre-embed semantic knowledge to improve the experts' ability in information selection and viewpoint sharing. Subsequently, the feature distribution of each modality is adaptively adjusted based on the respective experts' opinions. GAMED also introduces a novel classification technique to dynamically manage contributions from different modalities, while improving the explainability of decisions. Experimental results on the Fakeddit and Yang datasets demonstrate that GAMED performs better than recently developed state-of-the-art models. The source code can be accessed at https://github.com/slz0925/GAMED.Keywords
All Related Versions
Funding Information
- Alan Turing Institute/DSO
- Interdisciplinary Research Pump-Priming Fund University of Southampton
- NVIDIA Academic Hardware Grant Program
This publication has 48 references indexed in Scilit:
- Disinformation detection using graph neural networks: a surveyArtificial Intelligence Review, 2024
- A comprehensive survey of multimodal fake news detection techniques: advances, challenges, and opportunitiesInternational Journal of Multimedia Information Retrieval, 2023
- Multimodal fake news detection on social media: a survey of deep learning techniquesSocial Network Analysis and Mining, 2023
- An application study on multimodal fake news detection based on Albert-ResNet50 ModelMultimedia Tools and Applications, 2023
- Identifying multimodal misinformation leveraging novelty detection and emotion recognitionJournal of Intelligent Information Systems, 2023
- KG-MFEND: an efficient knowledge graph-based model for multi-domain fake news detectionThe Journal of Supercomputing, 2023
- Multi-modal transformer using two-level visual features for fake news detectionApplied Intelligence, 2022
- MCred: multi-modal message credibility for fake news detection using BERT and CNNJournal of Ambient Intelligence and Humanized Computing, 2022
- Deep learning for fake news detection: A comprehensive surveyAI Open, 2022
- $\mathsf {SAFE}$: Similarity-Aware Multi-modal Fake News Detection2020