TD-Net: A Hybrid End-to-End Network for Automatic Liver Tumor Segmentation From CT Images
- 13 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 27 (3) , 1163-1172
Abstract
Liver tumor segmentation plays an essential role in diagnosis and treatment of hepatocellular carcinoma or metastasis. However, accurate and automatic tumor segmentation remains a challenging task, owing to vague boundaries and large variations in shapes, sizes, and locations of liver tumors. In this paper, we propose a novel hybrid end-to-end network, called TD-Net, which incorporates Transformer and direction information into convolution network to segment liver tumor from CT images automatically. The proposed TD-Net is composed of a shared encoder, two decoding branches, four skip connections, and a direction guidance block. The shared encoder is utilized to extract multi-level feature information, and the two decoding branches are respectively designed to produce initial segmentation map and direction information. To preserve spatial information, four skip connections are used to concatenate each encoder layer and its corresponding decoder layer, and in the fourth skip connection a Transformer module is constructed to extract global context. Furthermore, a direction guidance block is well-designed to rectify feature maps to further improve segmentation accuracy. Extensive experiments conducted on public LiTS and 3DIRCADb datasets validate that the proposed TD-Net can effectively segment liver tumor from CT images in an end-to-end manner and its segmentation accuracy surpasses those of many existing methods.Keywords
Funding Information
- National Natural Science Foundation of China (62076256, 61702179, 61772555)
- Natural Science Foundation of Hunan Province (2021JJ30275)
- Scientific Research Fund of Hunan Provincial Education Department (20B239)
- Postgraduate Scientific Research Innovation Project of Hunan Province (CX20200129)
- Fundamental Research Funds for the Central Universities of Central South University (2020zzts123)
This publication has 37 references indexed in Scilit:
- Automatic liver segmentation by integrating fully convolutional networks into active contour modelsMedical Physics, 2019
- Liver Tumor Segmentation Based on Multi-Scale Candidate Generation and Fractal Residual NetworkIEEE Access, 2019
- Cascaded atrous convolution and spatial pyramid pooling for more accurate tumor target segmentation for rectal cancer radiotherapyPhysics in Medicine & Biology, 2018
- Superpixel-based and boundary-sensitive convolutional neural network for automated liver segmentationPhysics in Medicine & Biology, 2018
- Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CTIEEE Transactions on Medical Imaging, 2018
- Fully convolutional network and sparsity-based dictionary learning for liver lesion detection in CT examinationsNeurocomputing, 2018
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields2016
- V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation2016
- A new unified level set method for semi-automatic liver tumor segmentation on contrast-enhanced CT imagesExpert Systems with Applications, 2012