AlLNet: Alternative Learning is Better for Multimodal Fake News Detection
- 10 February 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. 13 (3) , 3336-3349
Abstract
The significance of multimodal feature fusion in multimodal-based fake news detection is crucial. However, each modality’s contribution to the final detection outcome varies, and due to substantial differences in data distribution, a simple fusion approach is often inadequate. While existing works attempt to perform multimodal fusion using attention mechanisms, they still face the challenge of modal laziness—where a modality may be underutilized during training due to its low weight, resulting in insufficient learning. In this article, we propose the model alternative learning network (AlLNet). AlLNet addresses the issue of modal laziness by learning unimodal features separately during the training stage and employing an alternating independent training process. Additionally, it incorporates contrast learning to enhance the discriminative ability of image features. During the inference stage, AlLNet evaluates the uncertainty of different modalities using entropy and combines their predictions dynamically with appropriate weights to produce the final result. Moreover, AlLNet is designed to be lightweight and effectively handles modalities missing, making it well-suited for real-world applications. Our experiments conducted on three real-world datasets in English and Chinese demonstrate the advantages and effectiveness of our approach.Keywords
Funding Information
- Key Research and Development Program in Shaanxi Province of China (2024GX-YBXM-124)
This publication has 22 references indexed in Scilit:
- Learning Frequency-Aware Cross-Modal Interaction for Multimodal Fake News DetectionIEEE Transactions on Computational Social Systems, 2024
- Towards better representation learning using hybrid deep learning model for fake news detectionSocial Network Analysis and Mining, 2022
- Momentum Contrast for Unsupervised Visual Representation Learning2020
- FakeNewsNet: A Data Repository with News Content, Social Context, and Spatiotemporal Information for Studying Fake News on Social MediaBig Data, 2020
- $\mathsf {SAFE}$: Similarity-Aware Multi-modal Fake News Detection2020
- Exploiting Multi-domain Visual Information for Fake News Detection2019
- SpotFake: A Multi-modal Framework for Fake News Detection2019
- EANN2018
- Show and Tell: Lessons Learned from the 2015 MSCOCO Image Captioning ChallengeIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- ImageNet: A large-scale hierarchical image database2009