ConTNet: cross attention convolution and transformer for aneurysm image segmentation
Authors:
- 5 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3618-3625
Abstract
In recent years, Convolutional Neural Neural Networks (CNNs) and Transformer architectures have significantly advanced the field of medical image segmentation. Since CNNs can only obtain effective local feature representations, there is difficulty in establishing long-range dependencies. However, Transformer has gained extensive attention from researchers due to its powerful global context modeling capability. Therefore, to integrate the advantages of the two architectures, we propose a network of ConTNet that can combine local and global information, consisting of two parallel encoders, namely, the Transformer and the CNN encoder. The CNN encoder is a stack of deep convolution and Criss-cross attention module (CCAM), which aims to acquire local features while strengthening the connection with the surrounding pixel points. In addition, two different forms of features are fused and fed into the encoder to ensure semantic consistency. Extensive experiments on the aneurysm and polyp segmentation datasets demonstrate that ConTNet performs better due to other state-of-the-art methods.Keywords
Funding Information
- Research and Development
This publication has 25 references indexed in Scilit:
- Swin-Unet: Unet-Like Pure Transformer for Medical Image Segmentation2023
- UNeXt: MLP-Based Rapid Medical Image Segmentation Network2022
- Multi-compound Transformer for Accurate Biomedical Image Segmentation2021
- Convolution-Free Medical Image Segmentation Using Transformers2021
- TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation2021
- Medical Transformer: Gated Axial-Attention for Medical Image Segmentation2021
- Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation2020
- PraNet: Parallel Reverse Attention Network for Polyp Segmentation2020
- Kvasir-SEG: A Segmented Polyp Dataset2019
- UNet++: A Nested U-Net Architecture for Medical Image Segmentation2018