TPFR-Net: U-shaped model for lung nodule segmentation based on transformer pooling and dual-attention feature reorganization
Authors:
- 27 May 2023
- journal article
- research article
- Published by Springer Nature in Medical & Biological Engineering & Computing
- Vol. 61 (8) , 1929-1946
Abstract
Accurate segmentation of lung nodules is the key to diagnosing the lesion type of lung nodule. The complex boundaries of lung nodules and the visual similarity to surrounding tissues make precise segmentation of lung nodules challenging. Traditional CNN based lung nodule segmentation models focus on extracting local features from neighboring pixels and ignore global contextual information, which is prone to incomplete segmentation of lung nodule boundaries. In the U-shaped encoder-decoder structure, variations of image resolution caused by up-sampling and down-sampling result in the loss of feature information, which reduces the reliability of output features. This paper proposes transformer pooling module and dual-attention feature reorganization module to effectively improve the above two defects. Transformer pooling module innovatively fuses the self-attention layer and pooling layer in the transformer, which compensates for the limitation of convolution operation, reduces the loss of feature information in the pooling process, and decreases the computational complexity of the Transformer significantly. Dual-attention feature reorganization module innovatively employs the dual-attention mechanism of channel and spatial to improve the sub-pixel convolution, minimizing the loss of feature information during up-sampling. In addition, two convolutional modules are proposed in this paper, which together with transformer pooling module form an encoder that can adequately extract local features and global dependencies. We use the fusion loss function and deep supervision strategy in the decoder to train the model. The proposed model has been extensively experimented and evaluated on the LIDC-IDRI dataset, the highest Dice Similarity Coefficient is 91.84 and the highest sensitivity is 92.66, indicating the model's comprehensive capability has surpassed state-of-the-art UTNet. The model proposed in this paper has superior segmentation performance for lung nodules and can provide a more in-depth assessment of lung nodules' shape, size, and other characteristics, which is of important clinical significance and application value to assist physicians in the early diagnosis of lung nodules. Graphical AbstractKeywords
Funding Information
- National Natural Science Foundation of China (U21A20469)
- Natural Science Foundation of Shanxi Province (202203021211177)
This publication has 42 references indexed in Scilit:
- Learning image compressed sensing with sub-pixel convolutional generative adversarial networkPattern Recognition, 2020
- MultiResUNet : Rethinking the U-Net architecture for multimodal biomedical image segmentationNeural Networks, 2020
- Reducing the Hausdorff Distance in Medical Image Segmentation With Convolutional Neural NetworksIEEE Transactions on Medical Imaging, 2019
- DT-CNN: Dilated and Transposed Convolution Neural Network Accelerator for Real-Time Image Segmentation on Mobile Devices2019
- Lung nodule classification using deep Local–Global networksInternational Journal of Computer Assisted Radiology and Surgery, 2019
- Encoder–decoder network for pixel-level road crack detection in black-box imagesComputer-Aided Civil and Infrastructure Engineering, 2019
- CBAM: Convolutional Block Attention Module2018
- UNet++: A Nested U-Net Architecture for Medical Image Segmentation2018
- A fast weak-supervised pulmonary nodule segmentation method based on modified self-adaptive FCM algorithmSoft Computing, 2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015