Variability in interpretation of low-dose chest CT using computerized assessment in a nationwide lung cancer screening program: comparison of prospective reading at individual institutions and retrospective central reading
Authors:
- 30 October 2020
- journal article
- research article
- Published by Springer Nature in European Radiology
- Vol. 31 (5) , 2845-2855
Abstract
Objectives To evaluate the degree of variability in computer-assisted interpretation of low-dose chest CTs (LDCTs) among radiologists in a nationwide lung cancer screening (LCS) program, through comparison with a retrospective interpretation from a central laboratory. Materials and methods Consecutive baseline LDCTs (n = 3353) from a nationwide LCS program were investigated. In the institutional reading, 20 radiologists in 14 institutions interpreted LDCTs using computer-aided detection and semi-automated segmentation systems for lung nodules. In the retrospective central review, a single radiologist re-interpreted all LDCTs using the same system, recording any non-calcified nodules ≥ 3 mm without arbitrary rejection of semi-automated segmentation to minimize the intervention of radiologist’s discretion. Positive results (requiring additional follow-up LDCTs or diagnostic procedures) were initially classified by the lung CT screening reporting and data system (Lung-RADS) during the interpretation, while the classifications based on the volumetric criteria from the Dutch-Belgian lung cancer screening trial (NELSON) were retrospectively applied. Variabilities in positive rates were assessed with coefficients of variation (CVs). Results In the institutional reading, positive rates by the Lung-RADS ranged from 7.5 to 43.3%, and those by the NELSON ranged from 11.4 to 45.0% across radiologists. The central review exhibited higher positive rates by Lung-RADS (20.0% vs. 27.3%; p < .001) and the NELSON (23.1% vs. 37.0%; p < .001), and lower inter-institution variability (CV, 0.30 vs. 0.12, p = .003 by Lung-RADS; CV, 0.25 vs. 0.12, p = .014 by the NELSON) compared to the institutional reading. Conclusion Considerable inter-institution variability in the interpretation of LCS results is caused by different usage of the computer-assisted system. Key Points • Considerable variability existed in the interpretation of screening LDCT among radiologists partly from the different usage of the computerized system. • A retrospective reading of low-dose chest CTs in the central laboratory resulted in reduced variability but an increased positive rate.Keywords
Funding Information
- National R&D Program for Cancer Control, Ministry of Health and Welfare (1520230)
- National Healthy Promotion fund, Ministry of Health and Welfare (1760810-1)
This publication has 34 references indexed in Scilit:
- Volumetric computed tomography screening for lung cancer: three rounds of the NELSON trialEuropean Respiratory Journal, 2013
- Definition of a Positive Test Result in Computed Tomography Screening for Lung CancerAnnals of Internal Medicine, 2013
- Computer-Aided Nodule Detection and Volumetry to Reduce Variability Between Radiologists in the Interpretation of Lung Nodules at Low-Dose Screening Computed TomographyInvestigative Radiology, 2012
- Annual or biennial CT screening versus observation in heavy smokersEuropean Journal Of Cancer Prevention, 2012
- Variability of Lung Tumor Measurements on Repeat Computed Tomography Scans Taken Within 15 MinutesJournal of Clinical Oncology, 2011
- Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic ScreeningNew England Journal of Medicine, 2011
- Management of Lung Nodules Detected by Volume CT ScanningNew England Journal of Medicine, 2009
- Inadequacy of manual measurements compared to automated CT volumetry in assessment of treatment response of pulmonary metastases using RECIST criteriaEuropean Radiology, 2005
- Early Lung Cancer Action Project: overall design and findings from baseline screeningThe Lancet, 1999
- AN ASYMPTOTIC TEST FOR THE EQUALITY OF COEFFICIENTS OF VARIATION FROMk POPULATIONSStatistics in Medicine, 1996