Comparison of deep-learning and radiomics-based machine-learning methods for the identification of chronic obstructive pulmonary disease on low-dose computed tomography images
Open Access
- 1 March 2024
- journal article
- research article
- Published by AME Publishing Company in Quantitative Imaging in Medicine and Surgery
- Vol. 14 (3) , 2485-2498
Abstract
Background: Radiomics and artificial intelligence approaches have been developed to predict chronic obstructive pulmonary disease (COPD), but it is still unclear which approach has the best performance. Therefore, we established five prediction models that employed deep-learning (DL) and radiomics-based machine-learning (ML) approaches to identify COPD on low-dose computed tomography (LDCT) images and compared the relative performance of the different models to find the best model for identifying COPD. Methods: This retrospective analysis included 1,024 subjects (169 COPD patients and 855 control subjects) who underwent LDCT scans from August 2018 to July 2021. Five prediction models, including models that employed computed tomography (CT)-based radiomics features, chest CT images, quantitative lung density parameters, and demographic and clinical characteristics, were established to identify COPD by DL or ML approaches. Model 1 used CT-based radiomics features by ML method. Model 2 used a combination of CT-based radiomics features, lung density parameters, and demographic and clinical characteristics by ML method. Model 3 used CT images only by DL method. Model 4 used a combination of CT images, lung density parameters, and demographic and clinical characteristics by DL method. Model 5 used a combination of CT images, CT-based radiomics features, lung density parameters, and demographic and clinical characteristics by DL method. The accuracy, sensitivity, specificity, highest negative predictive values (NPVs), positive predictive values, and areas under the receiver operating characteristic (AUC) curve of the five prediction models were compared to examine their performance. The DeLong test was used to compare the AUCs of the different models. Results: In total, 107 radiomics features were extracted from each subject’s CT images, 17 lung density parameters were acquired by quantitative measurement, and 18 selected demographic and clinical characteristics were recorded in this study. Model 2 had the highest AUC [0.73, 95% confidence interval (CI): 0.64–0.82], while model 3 had the lowest AUC (0.65, 95% CI: 0.55–0.75) in the test set. Model 2 also had the highest sensitivity (0.84), the highest accuracy (0.81), and the highest NPV (0.36). In the test set, based on the AUC results, Model 2 significantly outperformed Model 1 (P=0.03). Conclusions: The results showed that the identification ability of models that employ CT-based radiomics features combined with lung density parameters, and demographic and clinical characteristics using ML methods performed better than the chest CT image-based DL methods. ML methods are more suitable and beneficial for COPD identification.Keywords
This publication has 24 references indexed in Scilit:
- Artificial Intelligence in COPD: New Venues to Study a Complex DiseaseBarcelona Respiratory Network, 2026
- COPD identification and grading based on deep learning of lung parenchyma and bronchial wall in chest CT imagesBritish Journal of Radiology, 2022
- A Novel CT-Based Radiomics Features Analysis for Identification and Severity Staging of COPDAcademic Radiology, 2022
- Severe Pulmonary Hypertension in COPDChest, 2022
- Computed Tomography Screening for Early Lung Cancer, COPD and Cardiovascular Disease in Shanghai: Rationale and Design of a Population-based Comparative StudyAcademic Radiology, 2021
- Prospects and Challenges of Radiomics by Using Nononcologic Routine Chest CTRadiology: Cardiothoracic Imaging, 2020
- Towards large-scale case-finding: training and validation of residual networks for detection of chronic obstructive pulmonary disease using low-dose CTThe Lancet Digital Health, 2020
- Subtyping COPD by Using Visual and Quantitative CT Imaging FeaturesChest, 2020
- Computational Radiomics System to Decode the Radiographic PhenotypeCancer Research, 2017
- COPD: the dangerous underestimate of 15%The Lancet, 2006