Benchmarking open-source automated thigh muscle MRI segmentation algorithms
Preprint
Abstract
Automatic segmentation of medical images could accelerate clinical and research workflows, yet existing tools are rarely compared independently on shared benchmarks, making it difficult to assess genuine progress. This is particularly consequential for limb muscle segmentation in magnetic resonance imaging (MRI), which underpins volumetric analysis, radiomics, and fat fraction quantification used as biomarkers in neuromuscular disease – applications where segmentation errors can directly affect interpretation. Despite the availability of multiple open-source segmentation tools spanning diverse architectures, no independent head-to-head comparison has appeared in the literature. We address this gap by evaluating eight tools, six of which run independently, and the other two of which are meant to be auxiliary algorithms once muscles have been somehow initially labeled. We evaluated these tools on three-dimensional MRI volumes across three base datasets and then later against derived datasets, assessing both quantitative metrics and qualitative usability. Our results reveal substantial performance variation across methods and datasets, with many methods showing reduced accuracy on pathological cases. Domain-specific models trained on large datasets consistently outperformed foundation models and newer general-purpose architectures. Our results reveal practical trade-offs between accuracy, generalizability, and ease of use that are critical for clinical adoption, while raising concerns for deployment on underrepresented populations and pathologies.Keywords
This publication has 31 references indexed in Scilit:
- Efficiency Versus Accuracy in 3D Medical Image Segmentation: A Deep Learning Model Comparison2026
- Deep learning-based framework for comprehensive quantification of thigh and calf muscles and adipose tissues from MRIMagnetic Resonance Materials in Physics, Biology and Medicine, 2025
- General Methods Make Great Domain-Specific Foundation Models: A Case-Study on Fetal Ultrasound2025
- Exploring foundation models for multi-class muscle segmentation in MR images of neuromuscular disorders: A comparative analysis of accuracy and uncertaintyComputer Methods and Programs in Biomedicine, 2025
- A Minimal Annotation Pipeline for Deep Learning Segmentation of Skeletal MusclesNMR in Biomedicine, 2025
- Importance of Aligning Training Strategy with Evaluation for Diffusion Models in 3D Multiclass Segmentation2024
- Diffusion models in medical imaging: A comprehensive surveyMedical Image Analysis, 2023
- The Impact of Fatty Infiltration on MRI Segmentation of Lower Limb Muscles in Neuromuscular Diseases: A Comparative Study of Deep Learning ApproachesJournal of Magnetic Resonance Imaging, 2023
- Towards automated organs at risk and target volumes contouring: Defining precision radiation therapy in the modern eraJournal of the National Cancer Center, 2022
- Addressing Bias in Artificial Intelligence in Health CareJAMA, 2019