Adaptive Decomposition and Shared Weight Volumetric Transformer Blocks for Efficient Patch-Free 3D Medical Image Segmentation
- 16 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 27 (10) , 4854-4865
Abstract
High resolution (HR) 3D medical image segmentation is vital for an accurate diagnosis. However, in the field of medical imaging, it is still a challenging task to achieve a high segmentation performance with cost-effective and feasible computation resources. Previous methods commonly use patch-sampling to reduce the input size, but this inevitably harms the global context and decreases the model's performance. In recent years, a few patch-free strategies have been presented to deal with this issue, but either they have limited performance due to their over-simplified model structures or they follow a complicated training process. In this study, to effectively address these issues, we present Adaptive Decomposition (A-Decomp) and Shared Weight Volumetric Transformer Blocks (SW-VTB). A-Decomp can adaptively decompose features and reduce their spatial size, which greatly lowers GPU memory consumption. SW-VTB is able to capture long-range dependencies at a low cost with its lightweight design and cross-scale weight-sharing mechanism. Our proposed cross-scale weight-sharing approach enhances the network's ability to capture scale-invariant core semantic information in addition to reducing parameter numbers. By combining these two designs together, we present a novel patch-free segmentation framework named VolumeFormer. Experimental results on two datasets show that VolumeFormer outperforms existing patch-based and patch-free methods with a comparatively fast inference speed and relatively compact design. Code is available at: https://github.com/Dootmaan/VolumeFormer .Keywords
Funding Information
- National Key Research and Development Project (2022YFC2504605)
- Natural Science Foundation of Zhejiang Province (LZ22F020012)
- Hangzhou Major Science and Technology Innovation Project (2022AIZD0147)
- Grant-in-Aid for Scientific Research from the Japanese Ministry for Education, Science, Culture and Sports (20KK0234, 21H03470, 20K21821)
This publication has 35 references indexed in Scilit:
- Improving RetinaNet for CT Lesion Detection with Dense Masks from Weak RECIST Labels2019
- Attentive CT Lesion Detection Using Deep Pyramid Inference with Multi-scale Booster2019
- Holistic decomposition convolution for effective semantic segmentation of medical volume imagesMedical Image Analysis, 2019
- Squeeze-and-Excitation Networks2018
- Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic featuresScientific Data, 2017
- Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields2016
- Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)IEEE Transactions on Medical Imaging, 2015
- Tricubic interpolation in three dimensionsInternational Journal for Numerical Methods in Engineering, 2005