MT-GPD: A Multimodal Deep Transfer Learning Model Enhanced by Auxiliary Mechanisms for Cross-Domain Online Fake News Detection
Open Access
- 24 February 2025
- journal article
- Published by SAGE Publications in Production and Operations Management
- Vol. 34 (8) , 2448-2470
Abstract
The proliferation of fake news, more recently multimodal fake news, poses a significant threat to individuals, organizations, and society. While online social media platforms have employed automated methods to combat fake news, they face two notable challenges: the scarcity of labeled data and the diversity of news domains. To enhance the effectiveness and efficiency of online platforms in mitigating the spread of fake news, this study proposes MT-GPD (multimodal deep transfer learning with gating network, model patch, and domain classifier) for cross-domain fake news detection. MT-GPD integrates three novel design artifacts as auxiliary mechanisms for enhancing multimodal deep transfer learning, including a gating network that captures the relative importance of textual and visual components of individual news articles for dynamic fusion; a customized model patch that balances detection performance and computational efficiency; and a domain classifier that adapts multimodal representations to a target news domain. We evaluate the performance of MT-GPD using news datasets spanning four different domains. The results demonstrate the efficacy and robustness of MT-GPD, providing strong evidence for the impacts of the proposed auxiliary mechanisms on improving fake news detection performance.Keywords
Funding Information
- Truist Business Research and Innovation Grant
- School of Data Science, UNC Charlotte
This publication has 35 references indexed in Scilit:
- Robust Domain Misinformation Detection via Multi-Modal Feature AlignmentIEEE Transactions on Information Forensics and Security, 2023
- Fake news detection based on a hybrid BERT and LightGBM modelsComplex & Intelligent Systems, 2023
- Multimodal fake news detection through data augmentation-based contrastive learningApplied Soft Computing, 2023
- HAN, image captioning, and forensics ensemble multimodal fake news detectionInformation Sciences, 2021
- Imbalance accuracy metric for model selection in multi-class imbalance classification problemsKnowledge-Based Systems, 2020
- FakeNewsNet: A Data Repository with News Content, Social Context, and Spatiotemporal Information for Studying Fake News on Social MediaBig Data, 2020
- Interactive Steering of Hierarchical ClusteringIEEE Transactions on Visualization and Computer Graphics, 2020
- Discovering differential features: Adversarial learning for information credibility evaluationInformation Sciences, 2020
- Automating Linguistics-Based Cues for Detecting Deception in Text-Based Asynchronous Computer-Mediated CommunicationsGroup Decision and Negotiation, 2004
- Monte Carlo cross validationChemometrics and Intelligent Laboratory Systems, 2001