Dominance aware multimodal rumor verification using reliability calibrated multi-expert inference
Open Access
- 8 July 2026
- journal article
- research article
- Published by Springer Nature in Discover Artificial Intelligence
- Vol. 6 (1)
Abstract
Modality imbalance undermines multimodal pattern recognition when auxiliary inputs are missing, noisy, or weakly aligned, causing fusion models to collapse toward quasi-unimodal shortcuts and produce unreliable confidence. We propose DOMINO, a dominance-aware framework that mitigates this failure through three mechanisms: (1) a closed-loop dominance controller that regulates auxiliary objectives during training, (2) a missing-safe residual fusion module that enables stable fallback under degraded modalities, and (3) reliability-aware inference via temperature scaling and weighted expert aggregation. Experiments on Weibo and MediaEval2015 demonstrate state-of-the-art performance, achieving 0.9785 macro-F1 on Weibo and 0.9559 macro-F1 on MediaEval2015, while substantially reducing expected calibration error compared with that of strong baselines. These results establish that dominance-aware control and missing-safe fusion are effective principles for robust multimodal recognition under structural modality imbalance.Keywords
This publication has 27 references indexed in Scilit:
- Context aware hierarchical alignment for robust multimodal three stream sentiment analysisDiscover Artificial Intelligence, 2026
- DCLR: mitigating modality imbalance in multimodal fake news detection via dynamic contrastive learning with re-initializationMultimedia Systems, 2025
- Multi-modal fake news detection: A comprehensive survey on deep learning technology, advances, and challengesJournal of King Saud University Computer and Information Sciences, 2025
- A review of deep-learning-based models for afaan oromo fake news detection on social media networksDiscover Artificial Intelligence, 2025
- Rumor detection using dual embeddings and text-based graph convolutional networkDiscover Artificial Intelligence, 2024
- Escaping the neutralization effect of modality features fusion in multimodal Fake News DetectionInformation Fusion, 2024
- Adaptive temperature scaling for Robust calibration of deep neural networksNeural Computing and Applications, 2024
- MFIR: Multimodal fusion and inconsistency reasoning for explainable fake news detectionInformation Fusion, 2023
- TRIMOON: Two-Round Inconsistency-based Multi-modal fusion Network for fake news detectionInformation Fusion, 2022
- AMFB: Attention based multimodal Factorized Bilinear Pooling for multimodal Fake News DetectionExpert Systems with Applications, 2021