U-Next: A Novel Convolution Neural Network With an Aggregation U-Net Architecture for Gallstone Segmentation in CT Images
Open Access
- 18 November 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 166823-166832
Abstract
The incidence of cholelithiasis is more than 10% in the natural population. It is a common and frequently occurring disease worldwide. The lesions are predominantly sand-like and are difficult to distinguish in medical images. Although ultrasound is often the first-line technique for diagnosing cholelithiasis, CT plays an important role in diagnosing complications related to gallstones. To the best of our knowledge, no effective method has been proposed for segmenting CT images of gallstones. To address this difficulty, we have proposed a novel deep learning segmentation model, U-NeXt, which can automatically provide the importance of different shapes and sizes of target structures in images. a) We proposed attention up-sampling blocks for up-sampling. b) We also proposed a spatial pyramid pooling of skip connections, which is called SkipSPP. A series of convolution layers are connected by jumping connections to generate multi-scale features. c) We employed a dense connection to many details of the model to extract more features. In addition, we contributed a new data set for gallstone segmentation, which is co-labelled by three chief physicians from the hepatobiliary department and the medical imaging department of Shandong Province Third Hospital, China. The data set included 5,350 images from 726 patients. Compared with the previous best CT image segmentation method for gallstones, the intersection over union (IoU) improved by 24%, and compared with the medical image segmentation baseline model, the IoU improved by 7%, with a satisfactory segmentation effect. We extended U-NeXt to the nuclei segmentation task, showing that the model has good generalizability.Keywords
Funding Information
- National Natural Science Foundation of China (61572522, 61572523, 61672033, 61672248, 61873280, 61873281)
- Development Program of Shandong Province (2017GGX10147)
- Research Project (TIN2016-81079-R)
- Talento-Comunidad de Madrid, Project (TIN2016-81079-R, 2016-T2/TIC- 2024)
- InGEMICS-CM, FSE/FEDER, Comunidad de Madrid-EU (B2017/BMD-3691)
This publication has 13 references indexed in Scilit:
- DSOD: Learning Deeply Supervised Object Detectors from Scratch2017
- Focal Loss for Dense Object Detection2017
- Automatic 3D Cardiovascular MR Segmentation with Densely-Connected Volumetric ConvNets2017
- Automatic gallbladder and gallstone regions segmentation in ultrasound imageInternational Journal of Computer Assisted Radiology and Surgery, 2017
- Brain tumor segmentation with Deep Neural NetworksMedical Image Analysis, 2017
- The Importance of Skip Connections in Biomedical Image Segmentation2016
- Ask, Attend and Answer: Exploring Question-Guided Spatial Attention for Visual Question Answering2016
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification2015
- A lore-based FCM algorithm for gallstone CT images segmentation2015
- Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network2013