Radiomics-Based Quality Control System for Automatic Cardiac Segmentation: A Feasibility Study
Open Access
- 1 July 2023
- journal article
- research article
- Published by MDPI AG in Bioengineering
- Vol. 10 (7) , 791
Abstract
Purpose: In the past decade, there has been a rapid increase in the development of automatic cardiac segmentation methods. However, the automatic quality control (QC) of these segmentation methods has received less attention. This study aims to address this gap by developing an automatic pipeline that incorporates DL-based cardiac segmentation and radiomics-based quality control. Methods: In the DL-based localization and segmentation part, the entire heart was first located and cropped. Then, the cropped images were further utilized for the segmentation of the right ventricle cavity (RVC), myocardium (MYO), and left ventricle cavity (LVC). As for the radiomics-based QC part, a training radiomics dataset was created with segmentation tasks of various quality. This dataset was used for feature extraction, selection, and QC model development. The model performance was then evaluated using both internal and external testing datasets. Results: In the internal testing dataset, the segmentation model demonstrated a great performance with a dice similarity coefficient (DSC) of 0.954 for whole heart segmentations. Images were then appropriately cropped to 160 × 160 pixels. The models also performed well for cardiac substructure segmentations. The DSC values were 0.863, 0.872, and 0.940 for RVC, MYO, and LVC for 2D masks and 0.928, 0.886, and 0.962 for RVC, MYO, and LVC for 3D masks with an attention-UNet. After feature selection with the radiomics dataset, we developed a series of models to predict the automatic segmentation quality and its DSC value for the RVC, MYO, and LVC structures. The mean absolute values for our best prediction models were 0.060, 0.032, and 0.021 for 2D segmentations and 0.027, 0.017, and 0.011 for 3D segmentations, respectively. Additionally, the radiomics-based classification models demonstrated a high negative detection rate of >0.85 in all 2D groups. In the external dataset, models showed similar results. Conclusions: We developed a pipeline including cardiac substructure segmentation and QC at both the slice (2D) and subject (3D) levels. Our results demonstrate that the radiomics method possesses great potential for the automatic QC of cardiac segmentation.Keywords
Funding Information
- National Science Fund for National Natural Science Foundation of China (U21A20341, 81971570, 21XD1432100, 20Y11910500, SHDC2020CR2025B, YG2019ZDA13, 20172014)
- Shanghai Academic/Technology Leader Program (U21A20341, 81971570, 21XD1432100, 20Y11910500, SHDC2020CR2025B, YG2019ZDA13, 20172014)
- Shanghai Science and Technology Commission Program (U21A20341, 81971570, 21XD1432100, 20Y11910500, SHDC2020CR2025B, YG2019ZDA13, 20172014)
- Clinical Research Plan of SHDC (U21A20341, 81971570, 21XD1432100, 20Y11910500, SHDC2020CR2025B, YG2019ZDA13, 20172014)
- Shanghai Jiaotong University (U21A20341, 81971570, 21XD1432100, 20Y11910500, SHDC2020CR2025B, YG2019ZDA13, 20172014)
- Shanghai Municipal Education Commission Gaofeng Clinical Medicine (U21A20341, 81971570, 21XD1432100, 20Y11910500, SHDC2020CR2025B, YG2019ZDA13, 20172014)
This publication has 40 references indexed in Scilit:
- Reverse Classification Accuracy: Predicting Segmentation Performance in the Absence of Ground TruthIEEE Transactions on Medical Imaging, 2017
- Feature selection based on mutual information2015
- Recommendations for Cardiac Chamber Quantification by Echocardiography in Adults: An Update from the American Society of Echocardiography and the European Association of Cardiovascular ImagingJournal of the American Society of Echocardiography, 2015
- 2014 ESC Guidelines on diagnosis and management of hypertrophic cardiomyopathyEuropean Heart Journal, 2014
- scikit-image: image processing in PythonPeerJ, 2014
- 2013 ESH/ESC guidelines for the management of arterial hypertension.2013
- 2013 ESH/ESC Guidelines for the management of arterial hypertensionEuropean Heart Journal, 2013
- The Design of SimpleITKFrontiers in Neuroinformatics, 2013
- Evaluating Segmentation Error without Ground Truth2012
- User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliabilityNeuroImage, 2006