MCBTNet: Multi-Feature Fusion CNN and Bi- Level Routing Attention Transformer-Based Medical Image Segmentation Network
- 24 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 29 (7) , 5069-5082
Abstract
Accurate medical image segmentation is crucial for precise diagnosis and treatment in clinical pathology analysis and surgical navigation. While Convolutional Neural Network (CNN)-based approaches excel in capturing and analyzing local features, they often lose key global context. Transformers, utilizing self-attention mechanisms, address this issue but often overlook localized and multi-scale features while also requiring significant computational resources. To integrate the advantages of CNNs and Transformers to achieve efficient and precise medical image segmentation, we propose a segmentation framework based on multi-feature fusion CNN and Bi-level Routing Attention Transformer (MCBTNet). MCBTNet integrates CNNs and Transformers within a U-shaped encoderdecoder architecture. This configuration not only extracts multi-scale features via the U-shaped structure but also efficiently captures global contextual information through the dynamic sparsity of the Bi-Level Routing Attention Transformer. Our novel Frequency-Channel-Spatial multidimensional attention mechanism is implemented on skip connections, enhancing segmentation accuracy and speed by maximizing multi-scale feature utilization. Finally, MCBTNet obtains the segmentation result by fusing the predictions of different scales. Experimental results on five public datasets demonstrate that MCBTNet outperforms state-of-the-art methods in Dice and HD metrics, with lower computational and memory requirements. The code will be available on https://github.com/670768312/MCBTNet.Keywords
Funding Information
- National Key R&D Program of China (2023YFC2412100)
- Shenzhen Medical Research Fund (D2404002)
- National Natural Science Foundation of China (62275062)
- Shandong Innovation and Startup Community of High-end Medical Apparatus and Instruments (2023-SGTTXM-002, 2024-SGTTXM-005)
- Shandong Province Technology Innovation Guidance Plan
- Central Leading Local Science and Technology Development Fund (YDZX2023115)
- Taishan Scholar Special Funding Project of Shandong Province
- Shandong Laboratory of Advanced Biomaterials (ZL202402)
This publication has 29 references indexed in Scilit:
- DCSAU-Net: A deeper and more compact split-attention U-Net for medical image segmentationComputers in Biology and Medicine, 2023
- DenseUNet: Improved image classification method using standard convolution and dense transposed convolutionKnowledge-Based Systems, 2022
- nnU-Net: a self-configuring method for deep learning-based biomedical image segmentationNature Methods, 2020
- End-to-End Object Detection with Transformers2020
- Evolution of Image Segmentation using Deep Convolutional Neural Network: A SurveyKnowledge-Based Systems, 2020
- UNet++: A Nested U-Net Architecture for Medical Image Segmentation2018
- Feature Pyramid Networks for Object Detection2017
- Pyramid Scene Parsing Network2017
- V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015