Reducing Aleatoric and Epistemic Uncertainty Through Multi-modal Data Acquisition
Open Access
- 9 May 2026
- journal article
- research article
- Published by Springer Nature in Machine Learning
- Vol. 115 (5) , 121
Abstract
To generate accurate and reliable predictions, modern AI systems need to combine data from multiple modalities, such as text, images, audio, spreadsheets, and time series. However, collecting training and test data for many modalities is challenging and time-consuming, creating a need for cost-efficient multi-modal data acquisition. In this paper we advocate that this can be realized by disentangling epistemic and aleatoric uncertainty. It is commonly assumed in the machine learning community that epistemic uncertainty can be reduced by collecting more data, while aleatoric uncertainty is irreducible. We claim that this assumption can be challenged in modern multi-modal AI systems, and we introduces an innovative data acquisition framework where uncertainty disentanglement leads to actionable decisions, allowing cost-efficient sampling in two directions: sample size and data modality. The main hypothesis is that aleatoric uncertainty decreases as the number of modalities increases, while epistemic uncertainty decreases by collecting more observations. We provide a theoretical analysis and proof-of-concept implementations on various multi-modal datasets to prove the usefulness of our framework, which combines ideas from active learning, active feature acquisition and uncertainty quantification.Keywords
All Related Versions
Funding Information
- Fondation CentraleSupélec
This publication has 36 references indexed in Scilit:
- Evidential uncertainty sampling strategies for active learningMachine Learning, 2024
- A review of uncertainty quantification in medical image analysis: Probabilistic and non-probabilistic methodsMedical Image Analysis, 2024
- Learning Sets of Probabilities Through Ensemble Methods2023
- How to measure uncertainty in uncertainty sampling for active learningMachine Learning, 2021
- Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methodsMachine Learning, 2021
- A survey on machine learning for data fusionInformation Fusion, 2020
- Aleatoric and Epistemic Uncertainty with Random Forests2020
- Bagging predictorsMachine Learning, 1996
- A Sequential Algorithm for Training Text Classifiers1994
- Properties of measures of information in evidence and possibility theoriesFuzzy Sets and Systems, 1987