Diagnostic performance of deep learning-based vessel extraction and stenosis detection on coronary computed tomography angiography for coronary artery disease: a multi-reader multi-case study
Authors:
- 17 February 2023
- journal article
- research article
- Published by Springer Nature in La radiologia medica
- Vol. 128 (3) , 307-315
Abstract
Background Post-processing and interpretation of coronary CT angiography (CCTA) imaging are time-consuming and dependent on the reader’s experience. An automated deep learning (DL)-based imaging reconstruction and diagnosis system was developed to improve diagnostic accuracy and efficiency. Methods Our study including 374 cases from five sites, inviting 12 radiologists, assessed the DL-based system in diagnosing obstructive coronary disease with regard to diagnostic performance, imaging post-processing and reporting time of radiologists, with invasive coronary angiography as a standard reference. The diagnostic performance of DL system and DL-assisted human readers was compared with the traditional method of human readers without DL system. Results Comparing the diagnostic performance of human readers without DL system versus with DL system, the AUC was improved from 0.81 to 0.82 (p < 0.05) at patient level and from 0.79 to 0.81 (p < 0.05) at vessel level. An increase in AUC was observed in inexperienced radiologists (p < 0.05), but was absent in experienced radiologists. Regarding diagnostic efficiency, comparing the DL system versus human reader, the average post-processing and reporting time was decreased from 798.60 s to 189.12 s (p < 0.05). The sensitivity and specificity of using DL system alone were 93.55% and 59.57% at patient level and 83.23% and 79.97% at vessel level, respectively. Conclusions With the DL system serving as a concurrent reader, the overall post-processing and reading time was substantially reduced. The diagnostic accuracy of human readers, especially for inexperienced readers, was improved. DL-assisted human reader had the potential of being the reading mode of choice in clinical routine.Keywords
Funding Information
- Natural Science Foundation of Shanghai Municipality (8217070113)
This publication has 36 references indexed in Scilit:
- Fast Marching and Runge–Kutta Based Method for Centreline Extraction of Right Coronary Artery in Human PatientsCardiovascular Engineering and Technology, 2016
- Subtraction coronary computed tomography in patients with severe calcificationThe International Journal of Cardiovascular Imaging, 2015
- Multi-Reader Multi-Case Studies Using the Area under the Receiver Operator Characteristic Curve as a Measure of Diagnostic Accuracy: Systematic Review with a Focus on Quality of Data ReportingPLOS ONE, 2014
- SCCT guidelines for the interpretation and reporting of coronary CT angiography: A report of the Society of Cardiovascular Computed Tomography Guidelines CommitteeJournal of Cardiovascular Computed Tomography, 2014
- Computer-Aided CT coronary artery stenosis detection: comparison with human reading and quantitative coronary angiographyThe International Journal of Cardiovascular Imaging, 2014
- Accuracy of Coronary CT Angiography Using a Submillisievert Fraction of Radiation ExposureJACC, 2014
- Accuracy of prospectively ECG-triggered very low-dose coronary dual-source CT angiography using iterative reconstruction for the detection of coronary artery stenosis: comparison with invasive catheterizationEuropean Heart Journal - Cardiovascular Imaging, 2014
- Influence of observer experience and training on proficiency in coronary CT angiography interpretationEuropean Journal of Radiology, 2013
- Learning Curve for Coronary CT Angiography: What Constitutes Sufficient Training?Radiology, 2009
- Diagnostic Performance of 64-Multidetector Row Coronary Computed Tomographic Angiography for Evaluation of Coronary Artery Stenosis in Individuals Without Known Coronary Artery DiseaseJACC, 2008