Optimizing and evaluating robustness of AI for brain metastasis detection and segmentation via loss functions and multi-dataset training
Open Access
- 6 January 2026
- journal article
- Published by IOP Publishing in Biomedical Physics & Engineering Express
- Vol. 12 (1) , 015039
Abstract
Purpose . Accurate detection and segmentation of brain metastases (BM) from MRI are critical for the appropriate management of cancer patients. This study investigates strategies to enhance the robustness of artificial intelligence (AI)-based BM detection and segmentation models. Method . A DeepMedic-based network with a loss function, tunable with a sensitivity/specificity tradeoff weighting factor α - was trained on T1 post-contrast MRI datasets from two institutions (514 patients, 4520 lesions). Robustness was evaluated on an external dataset from a third institution dataset (91 patients, 397 lesions), featuring ground truth annotations from two physicians. We investigated the impact of loss function weighting factor, α and training dataset combinations. Detection performance (sensitivity, precision, F1 score) and segmentation accuracy (Dice similarity, and 95% Hausdorff distance (HD95)) were evaluated using one physician’s contours as the reference standard. The optimal AI model was then directly compared to the performance of the second physician. Results . Varying α demonstrated a trade-off between sensitivity (higher α ) and precision (lower α ), with α = 0.5 yielding the best F1 score (0.80 versus 0.78 for α = 0.95 and 0.72 for α = 0.99) on the external dataset. The optimally trained model achieved detection performance comparable to the physician (F1: AI = 0.83, Physician = 0.83), but slightly underperformed in segmentation (Dice: 0.81 versus AI = 0.69; HD95: 3.0 mm versus AI = 4.94 mm, p < 0.05). Conclusion . The derived optimal model achieves detection and segmentation performance comparable to an expert physician in a parallel comparison.Keywords
Funding Information
- RSNA R&E (RSCH24-209)
This publication has 34 references indexed in Scilit:
- Early experience with an artificial intelligence-based module for brain metastasis detection and segmentationJournal of Neuro-Oncology, 2024
- Preoperative CT‐based radiomics and deep learning model for predicting risk stratification of gastric gastrointestinal stromal tumorsMedical Physics, 2024
- A transfer learning approach on MRI-based radiomics signature for overall survival prediction of low-grade and high-grade gliomasMedical & Biological Engineering & Computing, 2023
- Automated Brain Metastases Segmentation With a Deep Dive Into False-positive DetectionAdvances in Radiation Oncology, 2022
- Deep learning for brain metastasis detection and segmentation in longitudinal MRI dataMedical Physics, 2022
- SynthStrip: skull-stripping for any brain imageNeuroImage, 2022
- Loss odyssey in medical image segmentationMedical Image Analysis, 2021
- Fully Automated MR Detection and Segmentation of Brain Metastases in Non‐small Cell Lung Cancer Using Deep LearningJournal of Magnetic Resonance Imaging, 2021
- Epidemiology of Brain MetastasesCurrent Oncology Reports, 2011
- Management of brain metastasesJournal of Neurology, 2002