A multimodal diagnosis model combining multi-granularity contrastive learning and quality-aware adaptive fusion
Authors:
- Ruiquan GeRGRuiquan Ge
- Zhipeng WangZWZhipeng Wang
- Deqiang XiaoDXDeqiang Xiao
- Gangyong JiaGJGangyong Jia
- Zhihao XingZXZhihao Xing
- Xiang WanXWXiang Wan
- Changmiao WangCWChangmiao Wang
- Ahmed ElazabAEAhmed Elazab
- 9 October 2026
- journal article
- Published by Elsevier in Pattern Recognition
- Vol. 183
Abstract
No abstract availableFunding Information
- National Natural Science Foundation of China (U22A2033)
- National Natural Science Foundation of China (61702146)
- National Natural Science Foundation of China (62076084)
- National Natural Science Foundation of China (U20A20386)
- Basic and Applied Basic Research Foundation of Guangdong Province (2025A1515011617)
- Basic and Applied Basic Research Foundation of Guangdong Province (2022A1515110570)
- Natural Science Foundation of Zhejiang Province (LY21F020017)
- Natural Science Foundation of Zhejiang Province (2023C03090)
This publication has 20 references indexed in Scilit:
- Hyperfusion: A hypernetwork approach to multimodal integration of tabular and medical imaging data for predictive modelingMedical Image Analysis, 2025
- Application of deep learning-based multimodal fusion technology in cancer diagnosis: A surveyEngineering Applications of Artificial Intelligence, 2025
- HEART: Learning better representation of EHR data with a heterogeneous relation-aware transformerJournal of Biomedical Informatics, 2024
- Multi-task supervised contrastive learning for chest X-ray diagnosis: A two-stage hierarchical classification framework for COVID-19 diagnosisApplied Soft Computing, 2024
- Multi-modality MRI fusion with patch complementary pre-training for internet of medical things-based smart healthcareInformation Fusion, 2024
- Semi-supervised information fusion for medical image analysis: Recent progress and future perspectivesInformation Fusion, 2024
- ICAFusion: Iterative cross-attention guided feature fusion for multispectral object detectionPattern Recognition, 2023
- Co-Attention Fusion Network for Multimodal Skin Cancer DiagnosisPattern Recognition, 2022
- DAFT: A universal module to interweave tabular data and 3D images in CNNsNeuroImage, 2022
- Multi-task contrastive learning for automatic CT and X-ray diagnosis of COVID-19Pattern Recognition, 2021