Improved distinct bone segmentation in upper-body CT through multi-resolution networks
Authors:
Open Access
- 20 June 2023
- journal article
- research article
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 18 (11) , 2091-2099
Abstract
Purpose: Automated distinct bone segmentation from CT scans is widely used in planning and navigation workflows. U-Net variants are known to provide excellent results in supervised semantic segmentation. However, in distinct bone segmentation from upper-body CTs a large field of view and a computationally taxing 3D architecture are required. This leads to low-resolution results lacking detail or localisation errors due to missing spatial context when using high-resolution inputs. Methods: We propose to solve this problem by using end-to-end trainable segmentation networks that combine several 3D U-Nets working at different resolutions. Our approach, which extends and generalizes HookNet and MRN, captures spatial information at a lower resolution and skips the encoded information to the target network, which operates on smaller high-resolution inputs. We evaluated our proposed architecture against single-resolution networks and performed an ablation study on information concatenation and the number of context networks. Results: Our proposed best network achieves a median DSC of 0.86 taken over all 125 segmented bone classes and reduces the confusion among similar-looking bones in different locations. These results outperform our previously published 3D U-Net baseline results on the task and distinct bone segmentation results reported by other groups. Conclusion: The presented multi-resolution 3D U-Nets address current shortcomings in bone segmentation from upper-body CT scans by allowing for capturing a larger field of view while avoiding the cubic growth of the input pixels and intermediate computations that quickly outgrow the computational capacities in 3D. The approach thus improves the accuracy and efficiency of distinct bone segmentation from upper-body CT.Keywords
All Related Versions
Funding Information
- University of Basel
This publication has 21 references indexed in Scilit:
- HookNet: Multi-resolution convolutional neural networks for semantic segmentation in histopathology whole-slide imagesMedical Image Analysis, 2021
- 3D Segmentation Networks for Excessive Numbers of Classes: Distinct Bone Segmentation in Upper Bodies2020
- Bone segmentation on whole-body CT using convolutional neural network with novel data augmentation techniquesComputers in Biology and Medicine, 2020
- Coarse to Fine Vertebrae Localization and Segmentation with SpatialConfiguration-Net and U-Net2020
- Deep learning for segmentation of 49 selected bones in CT scans: First step in automated PET/CT-based 3D quantification of skeletal metastasesEuropean Journal of Radiology, 2019
- Automated Recognition of Erector Spinae Muscles and Their Skeletal Attachment Region via Deep Learning in Torso CT Images2019
- Automatic bone segmentation in whole-body CT imagesInternational Journal of Computer Assisted Radiology and Surgery, 2018
- Multi-resolution Networks for Semantic Segmentation in Whole Slide Images2018
- Automatic and hierarchical segmentation of the human skeleton in CT imagesPhysics in Medicine & Biology, 2017
- V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation2016