MSCD-VM-UNet: A Vision Mamba Combining Multi-Scale Global and Local Feature Extraction With Cross-Domain Feature Fusion for Medical Image Segmentation
- 2 June 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 29 (10) , 7312-7325
Abstract
Accurate segmentation of tissues and lesions is essential for diagnosis and treatment. State Space Models (SSMs) have gained attention for their linear complexity and ability to model long-range dependencies. However, the existing Mamba architecture relies on direct skip connections, which limits its ability to integrate multi-scale and multi-level features and handle boundary details effectively. To address these limitations, we propose the MSCD-VM-UNet architecture, which incorporates three novel modules: the Spatial Group Multi-Scale Attention Module (SGMAM), the Cross-Domain Feature Fusion Module (CDFFM), and the Attention-Based Feature Injection Module (ABFIM). The SGMAM captures multi-scale global and local information and adaptively adjusts feature importance to highlight key regions while suppressing noise. The CDFFM enhances boundary and detail handling by aligning semantic features from both the frequency and spatial domains. The ABFIM utilizes attention mechanisms to adaptively fuse and weigh features from different scales and semantics, promoting feature collaboration and improving the model's robustness in complex tasks. Experiments on multiple datasets show that these modules significantly enhance the accuracy of MSCD-VM-UNet, setting a new benchmark for medical image segmentation. Our code will be made available at https://github.com/StphenWang/MSCD-VM-UNet.Keywords
Funding Information
- Natural Science Foundation of Chongqing Municipality (CSTB2024NSCQ-MSX0663)
This publication has 35 references indexed in Scilit:
- MGF‐net: Multi‐channel group fusion enhancing boundary attention for polyp segmentationMedical Physics, 2023
- Swin-Unet: Unet-Like Pure Transformer for Medical Image Segmentation2023
- TGANet: Text-Guided Attention for Improved Polyp Segmentation2022
- Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images2022
- Shallow Attention Network for Polyp Segmentation2021
- TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation2021
- Machine learning techniques for biomedical image segmentation: An overview of technical aspects and introduction to state‐of‐art applicationsMedical Physics, 2020
- Kvasir-SEG: A Segmented Polyp Dataset2019
- Selective Feature Aggregation Network with Area-Boundary Constraints for Polyp Segmentation2019
- UNet++: A Nested U-Net Architecture for Medical Image Segmentation2018