SALT: Introducing a Framework for Hierarchical Segmentations in Medical Imaging using Softmax for Arbitrary Label Trees
Preprint
Abstract
Traditional segmentation networks approach anatomical structures as standalone elements, overlooking the intrinsic hierarchical connections among them. This study introduces Softmax for Arbitrary Label Trees (SALT), a novel approach designed to leverage the hierarchical relationships between labels, improving the efficiency and interpretability of the segmentations. This study introduces a novel segmentation technique for CT imaging, which leverages conditional probabilities to map the hierarchical structure of anatomical landmarks, such as the spine's division into lumbar, thoracic, and cervical regions and further into individual vertebrae. The model was developed using the SAROS dataset from The Cancer Imaging Archive (TCIA), comprising 900 body region segmentations from 883 patients. The dataset was further enhanced by generating additional segmentations with the TotalSegmentator, for a total of 113 labels. The model was trained on 600 scans, while validation and testing were conducted on 150 CT scans. Performance was assessed using the Dice score across various datasets, including SAROS, CT-ORG, FLARE22, LCTSC, LUNA16, and WORD. Among the evaluated datasets, SALT achieved its best results on the LUNA16 and SAROS datasets, with Dice scores of 0.93 and 0.929 respectively. The model demonstrated reliable accuracy across other datasets, scoring 0.891 on CT-ORG and 0.849 on FLARE22. The LCTSC dataset showed a score of 0.908 and the WORD dataset also showed good performance with a score of 0.844. SALT used the hierarchical structures inherent in the human body to achieve whole-body segmentations with an average of 35 seconds for 100 slices. This rapid processing underscores its potential for integration into clinical workflows, facilitating the automatic and efficient computation of full-body segmentations with each CT scan, thus enhancing diagnostic processes and patient care.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- Performance and clinical applicability of machine learning in liver computed tomography imaging: a systematic reviewEuropean Radiology, 2023
- Deep learning‐based assessment of body composition and liver tumour burden for survival modelling in advanced colorectal cancerJournal of Cachexia, Sarcopenia and Muscle, 2022
- Radiomics analysis based on lumbar spine CT to detect osteoporosisEuropean Radiology, 2022
- End-to-end automated body composition analyses with integrated quality control for opportunistic assessment of sarcopenia in CTEuropean Radiology, 2021
- Fully automated body composition analysis in routine CT imaging using 3D semantic segmentation convolutional neural networksEuropean Radiology, 2020
- Differentiating Large from Small Bowel2019
- A novel MRI segmentation method using CNN‐based correction network for MRI‐guided adaptive radiotherapyMedical Physics, 2018
- Autosegmentation for thoracic radiation treatment planning: A grand challenge at AAPM 2017Medical Physics, 2018
- The Foundational Model of Anatomy Ontology2008
- Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition1990