Abstract
Accurate medical image segmentation is crucial for precise diagnosis and treatment in clinical pathology analysis and surgical navigation. While Convolutional Neural Network (CNN)-based approaches excel in capturing and analyzing local features, they often lose key global context. Transformers, utilizing self-attention mechanisms, address this issue but often overlook localized and multi-scale features while also requiring significant computational resources. To integrate the advantages of CNNs and Transformers to achieve efficient and precise medical image segmentation, we propose a segmentation framework based on multi-feature fusion CNN and Bi-level Routing Attention Transformer (MCBTNet). MCBTNet integrates CNNs and Transformers within a U-shaped encoderdecoder architecture. This configuration not only extracts multi-scale features via the U-shaped structure but also efficiently captures global contextual information through the dynamic sparsity of the Bi-Level Routing Attention Transformer. Our novel Frequency-Channel-Spatial multidimensional attention mechanism is implemented on skip connections, enhancing segmentation accuracy and speed by maximizing multi-scale feature utilization. Finally, MCBTNet obtains the segmentation result by fusing the predictions of different scales. Experimental results on five public datasets demonstrate that MCBTNet outperforms state-of-the-art methods in Dice and HD metrics, with lower computational and memory requirements. The code will be available on https://github.com/670768312/MCBTNet.
Funding Information
  • National Key R&D Program of China (2023YFC2412100)
  • Shenzhen Medical Research Fund (D2404002)
  • National Natural Science Foundation of China (62275062)
  • Shandong Innovation and Startup Community of High-end Medical Apparatus and Instruments (2023-SGTTXM-002, 2024-SGTTXM-005)
  • Shandong Province Technology Innovation Guidance Plan
  • Central Leading Local Science and Technology Development Fund (YDZX2023115)
  • Taishan Scholar Special Funding Project of Shandong Province
  • Shandong Laboratory of Advanced Biomaterials (ZL202402)