Improving confidence in MRI-based auto-segmentation via uncertainty assessment
Open Access
- 11 May 2026
- journal article
- Published by Medical Journals Sweden AB in Acta Oncologica
- Vol. 65, 406-411
Abstract
Background and purpose: Accurate delineation of organs of interest (OOIs, also commonly referred to as organs at risk, OARs) is crucial for safe radiotherapy. While deep learning-based segmentation using convolutional neural networks has achieved high geometric accuracy, clinical translation is hindered by overconfident, uncalibrated predictions in anatomically ambiguous regions. Uncertainty quantification and model calibration are prerequisites for safe clinical workflows. This study compared the standard nnU-Netv2 against its residual-encoding variant (ResEncM), hypothesizing that ResEncM would demonstrate superior reliability and calibration while maintaining comparable geometric accuracy. Patient/material and methods: T1-weighted contrast-enhanced MRI scans from 70 brain cancer patients were used (55 training/validation, 15 testing). Ground-truth contours for brainstem, hippocampi, chiasm, optic nerves, optic tracts, and pituitary were delineated per Danish Neuro Oncology Group guidelines. Both architectures were trained using five-fold cross-validation with identical preprocessing. Epistemic uncertainty was quantified using mutual information, and Expected Calibration Error (ECE) was computed within a 10-mm isotropic margin around reference contours. Results: Both models achieved high geometric accuracy (brainstem dice similarity coefficient [DSC] > 0.93, hippocampi DSC > 0.81). No significant geometric differences were found for large structures. ResEncM showed significantly lower DSC for the pituitary (p = 0.003) and chiasm (p = 0.018). However, ResEncM demonstrated significantly lower epistemic uncertainty and ensemble variance across all structures (p < 0.05), and significantly reduced ECE for the optic chiasm, optic tracts, and pituitary. Interpretation: Integrating a deep residual encoder into the standard U-Net framework significantly improves reliability and calibration of automated brain OOI contours while maintaining strong geometric performance. The ResEncM architecture provides a more trustworthy tool for clinical radiotherapy by reliably flagging high-uncertainty voxels, supporting confidence-aware clinical workflows.Keywords
This publication has 12 references indexed in Scilit:
- nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentation2024
- Artificial intelligence uncertainty quantification in radiotherapy applications − A scoping reviewRadiotherapy and Oncology, 2024
- Enhancing the reliability of deep learning-based head and neck tumour segmentation using uncertainty estimation with multi-modal imagesPhysics in Medicine & Biology, 2024
- Deep-learning magnetic resonance imaging-based automatic segmentation for organs-at-risk in the brain: Accuracy and impact on dose distributionPhysics and Imaging in Radiation Oncology, 2023
- A lightweight asymmetric U-Net framework for acute ischemic stroke lesion segmentation in CT and CTP imagesComputer Methods and Programs in Biomedicine, 2022
- A national study on the inter-observer variability in the delineation of organs at risk in the brainActa Oncologica, 2021
- Automated Brain Tumour Segmentation Using Cascaded 3D Densely-Connected U-Net2021
- Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methodsMachine Learning, 2021
- nnU-Net: a self-configuring method for deep learning-based biomedical image segmentationNature Methods, 2020
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015