From SAM 1 to SAM 3: Benchmarking Zero‐Shot Cross‐Domain Medical Image Segmentation
Open Access
- 3 September 2026
- journal article
- research article
- Published by Wiley in Expert Systems
- Vol. 43 (10) , e70383
Abstract
Segmentation models have demonstrated significant potential in medical image segmentation. However, there is currently a lack of systematic, cross‐generation comparative evaluations to assess whether the iterations from SAM1 to SAM 3 can effectively enhance the clinical applicability of zero‐shot segmentation. To address this issue, this paper systematically compares the zero‐shot segmentation performance of the SAM family across four representative medical imaging datasets which cover different imaging modalities. The evaluation framework encompasses multi‐dimensional metrics and introduces logarithmic‐domain HD95 analysis to capture and quantify boundary spillover behaviour. This paper demonstrates that the evolution from SAM1 to SAM 3 represents a qualitative leap rather than a linear accumulation; SAM 3 achieves a several‐fold increase in Dice score over SAM1 on most datasets, whilst effectively suppressing boundary spillover into background; conversely, SAM 2 shows no significant advantage over SAM1 in our benchmarks. Concurrently, the zero‐shot capabilities of the models exhibit a distinct modality gradient. Only in a few modalities can SAM 3 maintain acceptable segmentation results, while in all other modalities the entire SAM family consistently fails. In summary, SAM 3 demonstrates zero‐shot clinical applicability in specific modalities. Its semantic prompts are able to segment medical images more easily and accurately than visual prompts.Keywords
Funding Information
- National Research Foundation
This publication has 25 references indexed in Scilit:
- Medical image translation with deep learning: Advances, datasets and perspectivesMedical Image Analysis, 2025
- Medical SAM adapter: Adapting segment anything model for medical image segmentationMedical Image Analysis, 2025
- Trustworthy clinical AI solutions: A unified review of uncertainty quantification in Deep Learning models for medical image analysisArtificial Intelligence in Medicine, 2024
- Segment anything in medical imagesNature Communications, 2024
- Segment anything model for medical image analysis: An experimental studyMedical Image Analysis, 2023
- A survey of uncertainty in deep neural networksArtificial Intelligence Review, 2023
- Foundation models for generalist medical artificial intelligenceNature, 2023
- The Medical Segmentation DecathlonNature Communications, 2022
- Dataset of breast ultrasound imagesData in Brief, 2020
- IDRiD: Diabetic Retinopathy – Segmentation and Grading ChallengeMedical Image Analysis, 2020