Medical SAM: A Glioma Segmentation Fine-tuning Method for SAM Using Brain MR Images
Authors:
- 6 January 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-4
Abstract
Based on the 2016 World Health Organization (WHO) Classification scheme for gliomas, accurate glioma segmentation serves as a fundamental basis for glioma diagnosis. In the realm of glioma diagnosis, brain MRI has emerged as an indispensable diagnostic tool due to its ability to provide comprehensive information. Over the past decade, there has been a notable surge in the utilization of machine learning techniques, particularly deep learning, for processing medical images. These deep learning methods, based on convolutional neural networks or transformers, proposed analogous architectures such as U-Net for precise segmentation of medical images, thereby significantly enhancing the accuracy of brain glioma segmentation. Thanks to the development of foundation models, models pre-trained with large-scale datasets have achieved better results on a variety of tasks. However, for medical images with small dataset sizes, deep learning methods struggle to achieve better results than on real-world image datasets. In this study, we proposed an adapter to effectively fine-tune the foundation model (SAM) for improved glioma segmentation using brain MR images. The effectiveness of the proposed method is validated via our private glioma data set from the First Affiliated Hospital of Zhengzhou University (FHZU) in Zhengzhou, China. The proposed method outperforms current state-of-the-art methods, achieving a Dice coefficient of 87.33% and a Hausdorff distance of 10.87 for accurate segmentation of the glioma region in glioma treatment, representing a significant 4% improvement in Dice coefficient.Keywords
This publication has 11 references indexed in Scilit:
- Segment Anything2023
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScalearXiv, 2021
- TransUNet: Transformers Make Strong Encoders for Medical Image SegmentationarXiv, 2021
- GPT-3: Its Nature, Scope, Limits, and ConsequencesMinds and Machines, 2020
- Fully Dense UNet for 2-D Sparse Photoacoustic Tomography Artifact RemovalIEEE Journal of Biomedical and Health Informatics, 2019
- Weighted Res-UNet for High-Quality Retina Vessel Segmentation2018
- SimpleITK Image-Analysis Notebooks: a Collaborative Environment for Education and Reproducible ResearchJournal of Digital Imaging, 2017
- The 2016 World Health Organization Classification of Tumors of the Central Nervous System: a summaryActa Neuropathologica, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- The Design of SimpleITKFrontiers in Neuroinformatics, 2013