Deep learning-based automatic ASPECTS calculation can improve diagnosis efficiency in patients with acute ischemic stroke: a multicenter study
Authors:
- 27 July 2024
- journal article
- research article
- Published by Springer Nature in European Radiology
- Vol. 35 (2) , 627-639
Abstract
Objectives The Alberta Stroke Program Early CT Score (ASPECTS), a systematic method for assessing ischemic changes in acute ischemic stroke using non-contrast computed tomography (NCCT), is often interpreted relying on expert experience and can vary between readers. This study aimed to develop a clinically applicable automatic ASPECTS system employing deep learning (DL). Methods This study enrolled 1987 NCCT scans that were retrospectively collected from four centers between January 2017 and October 2021. A DL-based system for automated ASPECTS assessment was trained on a development cohort (N = 1767) and validated on an independent test cohort (N = 220). The consensus of experienced physicians was regarded as a reference standard. The validity and reliability of the proposed system were assessed against physicians’ readings. A real-world prospective application study with 13,399 patients was used for system validation in clinical contexts. Results The DL-based system achieved an area under the receiver operating characteristic curve (AUC) of 84.97% and an intraclass correlation coefficient (ICC) of 0.84 for overall-level analysis on the test cohort. The system’s diagnostic sensitivity was 94.61% for patients with dichotomized ASPECTS at a threshold of ≥ 6, with substantial agreement (ICC = 0.65) with expert ratings. Combining the system with physicians improved AUC from 67.43 to 89.76%, reducing diagnosis time from 130.6 ± 66.3 s to 33.3 ± 8.3 s (p < 0.001). During the application in clinical contexts, 94.0% (12,591) of scans successfully processed by the system were utilized by clinicians, and 96% of physicians acknowledged significant improvement in work efficiency. Conclusion The proposed DL-based system could accurately and rapidly determine ASPECTS, which might facilitate clinical workflow for early intervention. Clinical relevance statement The deep learning-based automated ASPECTS evaluation system can accurately and rapidly determine ASPECTS for early intervention in clinical workflows, reducing processing time for physicians by 74.8%, but still requires validation by physicians when in clinical applications. Key Points The deep learning-based system for ASPECTS quantification has been shown to be non-inferior to expert-rated ASPECTS. This system improved the consistency of ASPECTS evaluation and reduced processing time to 33.3 seconds per scan. 94.0% of scans successfully processed by the system were utilized by clinicians during the prospective clinical application.Keywords
Funding Information
- The National Natural Science Foundation of China (No. 8225024, No. 8225024, No. 8225024)
This publication has 30 references indexed in Scilit:
- Automated ASPECTS calculation may equal the performance of experienced clinicians: a machine learning study based on a large cohortEuropean Radiology, 2023
- Deep learning derived automated ASPECTS on non‐contrast CT scans of acute ischemic stroke patientsHuman Brain Mapping, 2022
- Global, regional, and national burden of stroke and its risk factors, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019The Lancet Neurology, 2021
- EIS-Net: Segmenting early infarct and scoring ASPECTS simultaneously on non-contrast CT of patients with acute ischemic strokeMedical Image Analysis, 2021
- Validation of automated Alberta Stroke Program Early CT Score (ASPECTS) software for detection of early ischemic changes on non-contrast brain CT scansNeuroradiology, 2020
- Automated ASPECT scoring in acute ischemic stroke: comparison of three software toolsNeuroradiology, 2020
- Impact of slice thickness on clinical utility of automated Alberta Stroke Program Early Computed Tomography ScoresEuropean Radiology, 2020
- Detection of early infarction signs with machine learning-based diagnosis by means of the Alberta Stroke Program Early CT score (ASPECTS) in the clinical routineNeuroradiology, 2018
- Corrigendum to “Medical image analysis methods in MR/CT-imaged acute–subacute ischemic stroke lesion: Segmentation, prediction and insights into dynamic evolution simulation models. A critical appraisal” [NeuroImage: Clinical 1 (2012) 164–178]NeuroImage: Clinical, 2013
- Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapyThe Lancet, 2000