Bilinear Learning with Dual-Chain Feature Attention for Multimodal Rumor Detection
Open Access
- 24 May 2025
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 13 (11) , 1731
Abstract
The rapid growth of social media and online information-sharing platforms facilitates the spread of rumors. Accurate rumor detection to minimize manual verification efforts remains a critical research challenge. While multimodal rumor detection leveraging both text and visual data has gained increasing attention due to the diversification of social media content, existing approaches face the following three key limitations: (1) yhey prioritize lexical features of text while neglecting inherent logical inconsistencies in rumor narratives; (2) they treat textual and visual features as independent modalities, failing to model their intrinsic connections; and (3) they overlook semantic incongruities between text and images, which are common in rumor content. This paper proposes a dual-chain multimodal feature learning framework for rumor detection to address these issues. The framework comprehensively extracts rumor content features through the following two parallel processes: a basic semantic feature extraction module that captures fundamental textual and visual semantics, and a logical connection feature learning module that models both the internal logical relationships within text and the cross-modal semantic alignment between text and images. The framework achieves the multi-level fusion of text–image features by integrating modal alignment and cross-modal attention mechanisms. Extensive experiments on the Pheme and Weibo datasets demonstrate that the proposed method performs better than baseline approaches, confirming its effectiveness in detecting multimodal rumors.Keywords
Funding Information
- National Natural Science Foundation of China (62072060)
This publication has 8 references indexed in Scilit:
- Improving Data Fusion for Fake News Detection: A Hybrid Fusion Approach for Unimodal and Multimodal DataIEEE Access, 2024
- MFAN: Multi-modal Feature-enhanced Attention Networks for Rumor Detection2022
- A multimodal fake news detection model based on crossmodal attention residual and multichannel convolutional neural networksInformation Processing & Management, 2021
- CED: Credible Early Detection of Social Media RumorsIEEE Transactions on Knowledge and Data Engineering, 2019
- SADHAN2019
- EleAtt-RNN: Adding Attentiveness to Neurons in Recurrent Neural NetworksIEEE Transactions on Image Processing, 2019
- VGGFace2: A Dataset for Recognising Faces across Pose and Age2018
- Faking Sandy2013