Facilitating standardized COVID-19 suspicion prediction based on computed tomography radiomics in a multi-demographic setting
Open Access
- 1 April 2022
- journal article
- research article
- Published by Springer Nature in European Radiology
- Vol. 32 (9) , 6384-6396
Abstract
Objective: To develop an automatic COVID-19 Reporting and Data System (CO-RADS)–based classification in a multi-demographic setting. Methods: This multi-institutional review boards–approved retrospective study included 2720 chest CT scans (mean age, 58 years [range 18–100 years]) from Italian and Russian patients. Three board-certified radiologists from three countries assessed randomly selected subcohorts from each population and provided CO-RADS–based annotations. CT radiomic features were extracted from the selected subcohorts after preprocessing steps like lung lobe segmentation and automatic noise reduction. We compared three machine learning models, logistic regression (LR), multilayer perceptron (MLP), and random forest (RF) for the automated CO-RADS classification. Model evaluation was carried out in two scenarios, first, training on a mixed multi-demographic subcohort and testing on an independent hold-out dataset. In the second scenario, training was done on a single demography and externally validated on the other demography. Results: The overall inter-observer agreement for the CO-RADS scoring between the radiologists was substantial (k = 0.80). Irrespective of the type of validation test scenario, suspected COVID-19 CT scans were identified with an accuracy of 84%. SHapley Additive exPlanations (SHAP) interpretation showed that the “wavelet_(LH)_GLCM_Imc1” feature had a positive impact on COVID prediction both with and without noise reduction. The application of noise reduction improved the overall performance between the classifiers for all types. Conclusion: Using an automated model based on the COVID-19 Reporting and Data System (CO-RADS), we achieved clinically acceptable performance in a multi-demographic setting. This approach can serve as a standardized tool for automated COVID-19 assessment. Keypoints: • Automatic CO-RADS scoring of large-scale multi-demographic chest CTs with mean AUC of 0.93 ± 0.04. • Validation procedure resembles TRIPOD 2b and 3 categories, enhancing the quality of experimental design to test the cross-dataset domain shift between institutions aiding clinical integration. • Identification of COVID-19 pneumonia in the presence of community-acquired pneumonia and other comorbidities with an AUC of 0.92.Keywords
Funding Information
- Interreg
- Scientific Support of the Capital's Healthcare (АААА-А20-120071090056-3, АААА-А20-120071090056-3, АААА-А20-120071090056-3)
This publication has 37 references indexed in Scilit:
- Potential value of the PixelShine deep learning algorithm for increasing quality of 70 kVp+ASiR-V reconstruction pelvic arterial phase CT imagesJapanese Journal of Radiology, 2018
- Explainable machine-learning predictions for the prevention of hypoxaemia during surgeryNature Biomedical Engineering, 2018
- Computational Radiomics System to Decode the Radiographic PhenotypeCancer Research, 2017
- Radiomics: the bridge between medical imaging and personalized medicineNature Reviews Clinical Oncology, 2017
- Quantitative radiomics studies for tissue characterization: a review of technology and methodological proceduresBritish Journal of Radiology, 2017
- Co-occurrence of Local Anisotropic Gradient Orientations (CoLlAGe): A new radiomics descriptorScientific Reports, 2016
- Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD StatementBMC Medicine, 2015
- Detection of ground-glass opacities by use of hybrid iterative reconstruction (iDose) and low-dose 256-section computed tomography: a phantom studyRadiological Physics and Technology, 2013
- SMOTE: Synthetic Minority Over-sampling TechniqueJournal of Artificial Intelligence Research, 2002
- Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric ApproachBiometrics, 1988