ISC-TRANSUNET: MEDICAL IMAGE SEGMENTATION NETWORK BASED ON THE INTEGRATION OF SELF-ATTENTION AND CONVOLUTION
- 7 October 2023
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in Journal of Mechanics in Medicine and Biology
- Vol. 23 (09)
Abstract
In the current medical image segmentation network, the combination of CNN and Transformer has become a mainstream trend. However, the inherent limitations of convolution operation in CNN and insufficient information interaction in Transformer affect the segmentation performance of the network. To solve these problems, an integrated self-attention and convolution medical image segmentation network (ISC-TransUNet) is proposed in this paper. The network consists of encoder, decoder and jump connection. First, the encoder uses a hybrid structure of BoTNet and Transformer to capture more comprehensive image information and reduce additional computing overhead. Then, the decoder uses an upper sampler cascaded by multiple DUpsampling upper blocks to accurately recover the pixel-level prediction. Finally, the feature fusion of encoder and decoder at different resolutions is realized by ResPath jump connection, which reduces the semantic difference between encoder and decoder. Through experiments on the Synapse multi-organ segmentation dataset, compared with the baseline model TransUNet, Dice similarity coefficient of ISC-TransUNet was improved by 1.13%, Hausdorff distance was reduced by 2.38%, and weight was maintained. The experimental results show that the network can effectively segment tissues and organs in medical images, which has important theoretical significance and application value for intelligent clinical diagnosis and treatment.Keywords
This publication has 13 references indexed in Scilit:
- Domain Adaptive Relational Reasoning for 3D Multi-organ Segmentation2020
- UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image SegmentationIEEE Transactions on Medical Imaging, 2019
- Deep Learning Techniques for Medical Image Segmentation: Achievements and ChallengesJournal of Digital Imaging, 2019
- Fully Dense UNet for 2-D Sparse Photoacoustic Tomography Artifact RemovalIEEE Journal of Biomedical and Health Informatics, 2019
- Weighted Res-UNet for High-Quality Retina Vessel Segmentation2018
- An Improvement for Medical Image Analysis Using Data Enhancement Techniques in Deep Learning2018
- V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation2016
- Deep Residual Learning for Image Recognition2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Fully convolutional networks for semantic segmentation2015