Transformer and group parallel axial attention co-encoder for medical image segmentation
Authors:
Open Access
- 27 September 2022
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 12 (1) , 1-17
Abstract
U-Net has become baseline standard in the medical image segmentation tasks, but it has limitations in explicitly modeling long-term dependencies. Transformer has the ability to capture long-term relevance through its internal self-attention. However, Transformer is committed to modeling the correlation of all elements, but its awareness of local foreground information is not significant. Since medical images are often presented as regional blocks, local information is equally important. In this paper, we propose the GPA-TUNet by considering local and global information synthetically. Specifically, we propose a new attention mechanism to highlight local foreground information, called group parallel axial attention (GPA). Furthermore, we effectively combine GPA with Transformer in encoder part of model. It can not only highlight the foreground information of samples, but also reduce the negative influence of background information on the segmentation results. Meanwhile, we introduced the sMLP block to improve the global modeling capability of network. Sparse connectivity and weight sharing are well achieved by applying it. Extensive experiments on public datasets confirm the excellent performance of our proposed GPA-TUNet. In particular, on Synapse and ACDC datasets, mean DSC(%) reached 80.37% and 90.37% respectively, mean HD95(mm) reached 20.55 and 1.23 respectively.Keywords
All Related Versions
Funding Information
- the National Science Foundation of China (U1903213)
This publication has 14 references indexed in Scilit:
- FAC-Net: Feedback Attention Network Based on Context Encoder Network for Skin Lesion SegmentationSensors, 2021
- QSAN: A Quantum-probability based Signed Attention Network for Explainable False Information Detection2020
- Multi-Scale Self-Guided Attention for Medical Image SegmentationIEEE Journal of Biomedical and Health Informatics, 2020
- CPFNet: Context Pyramid Fusion Network for Medical Image SegmentationIEEE Transactions on Medical Imaging, 2020
- Attention gated networks: Learning to leverage salient regions in medical imagesMedical Image Analysis, 2019
- CE-Net: Context Encoder Network for 2D Medical Image SegmentationIEEE Transactions on Medical Imaging, 2019
- UNet++: A Nested U-Net Architecture for Medical Image Segmentation2018
- H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT VolumesIEEE Transactions on Medical Imaging, 2018
- V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation2016
- Fully Convolutional Networks for Semantic SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016