MMNet: Multi-modal Fusion with Mutual Learning Network for Fake News Detection
Authors:
- Linmei HuLHLinmei Hu
- Ziwang ZhaoZZZiwang Zhao
- Xinkai GeXGXinkai Ge
- Xuemeng SongXSXuemeng Song
- Liqiang NieLNLiqiang Nie
Preprint
Abstract
The rapid development of social media provides a hotbed for the dissemination of fake news, which misleads readers and causes negative effects on society. News usually involves texts and images to be more vivid. Consequently, multi-modal fake news detection has received wide attention. Prior efforts primarily conduct multi-modal fusion by simple concatenation or co-attention mechanism, leading to sub-optimal performance. In this paper, we propose a novel mutual learning network based model MMNet, which enhances the multi-modal fusion for fake news detection via mutual learning between text- and vision-centered views towards the same classification objective. Specifically, we design two detection modules respectively based on text- and vision-centered multi-modal fusion features, and enable the mutual learning of the two modules to facilitate the multi-modal fusion, considering the latent consistency between the two modules towards the same training objective. Moreover, we also consider the influence of the image-text matching degree on news authenticity judgement by designing an image-text matching aware co-attention mechanism for multi-modal fusion. Extensive experiments are conducted on three benchmark datasets and the results demonstrate that our proposed MMNet achieves superior performance in fake news detection.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Memory-Guided Multi-View Multi-Domain Fake News DetectionIEEE Transactions on Knowledge and Data Engineering, 2022
- Category-controlled Encoder-Decoder for Fake News DetectionIEEE Transactions on Knowledge and Data Engineering, 2021
- An Integrated Multi-Task Model for Fake News DetectionIEEE Transactions on Knowledge and Data Engineering, 2021
- Multi Task Mutual Learning for Joint Sentiment Classification and Topic DetectionIEEE Transactions on Knowledge and Data Engineering, 2020
- Gaussian Processes for Rumour Stance Classification in Social MediaACM Transactions on Information Systems, 2019
- Novel Visual and Statistical Image Features for Microblogs News VerificationIEEE Transactions on Multimedia, 2016
- Overview of the Special Issue on Trust and Veracity of Information in Social MediaACM Transactions on Information Systems, 2016