Preprint
Abstract
S ummary: There is an overwhelmingly large body of literature and numerous algorithms already available on “multimodal AI”, based on different modeling and fusion paradigms. As multimodal AI becomes fully integrated into healthcare applications, the ability to say “I’m not sure” or “I don’t know” when uncertain is a necessary capability for safe clinical deployment, requiring the augmentation of current multimodal AI techniques. Our goal in this work is not to add yet another method to the growing toolbox of multimodal AI, but rather to (i) clarify how existing supervised multimodal AI methods can be understood through the lens of uncertainty quantification, and (ii) develop a unified framework that provides valid and interpretable uncertainty estimates for multimodal AI practitioners. We introduce Coracle, a conformalized framework for multimodal AI that seamlessly adapts to early, late, and intermediate fusion. Coracle provides theoretical marginal confidence guarantees and achieves valid finite-sample coverage without relying on distributional assumptions. Through extensive simulations and analyses of diverse biomedical multiview datasets, we demonstrate that Coracle consistently outperforms existing non-conformalized methods in both uncertainty estimation and calibration. By equipping published multiview models with valid, interpretable confidence measures, Coracle advances the development of trustworthy, uncertainty-aware statistical tools for biomedical decision support. Coracle is publicly available as an open-source R package at https://github.com/himelmallick/Coracle .Keywords
This publication has 46 references indexed in Scilit:
- The event of multiomics in metagenomics2025
- Empowering biomedical discovery with AI agentsCell, 2024
- Advance computational tools for multiomics data learningBiotechnology Advances, 2024
- Bayesian simultaneous factorization and prediction using multi-omic dataComputational Statistics & Data Analysis, 2024
- Computational frameworks integrating deep learning and statistical models in mining multimodal omics dataJournal of Biomedical Informatics, 2024
- An integrated Bayesian framework for multi‐omics prediction and classificationStatistics in Medicine, 2023
- Differential expression of single‐cell RNA‐seq data using Tweedie modelsStatistics in Medicine, 2022
- Multiview Learning in Biomedical Applications2019
- Safe probabilityJournal of Statistical Planning and Inference, 2018
- InterSIM: Simulation tool for multiple integrative ‘omic datasets’Computer Methods and Programs in Biomedicine, 2016