Accuracy of artificial intelligence software for CT angiography in stroke
Authors:
- Grant MairGMGrant Mair
- Philip WhitePWPhilip White
- Philip M. BathPBPhilip M. Bath
- Keith MuirKMKeith Muir
- David DyeDDDavid Dye
- Francesca ChappellFCFrancesca Chappell
- Rüdiger von KummerRKRüdiger von Kummer
- Malcolm MacleodMMMalcolm Macleod
- Nikola SpriggNSNikola Sprigg
- Joanna M. WardlawJWJoanna M. Wardlaw
- for the RITeS CollaborationFCfor the RITeS Collaboration
Open Access
- 19 May 2023
- journal article
- research article
- Published by Wiley in Annals of Clinical and Translational Neurology
- Vol. 10 (7) , 1072-1082
Abstract
Objective: Software developed using artificial intelligence may automatically identify arterial occlusion and provide collateral vessel scoring on CT angiography (CTA) performed acutely for ischemic stroke. We aimed to assess the diagnostic accuracy of e‐CTA by Brainomix™ Ltd by large‐scale independent testing using expert reading as the reference standard.Methods: We identified a large clinically representative sample of baseline CTA from 6 studies that recruited patients with acute stroke symptoms involving any arterial territory. We compared e‐CTA results with masked expert interpretation of the same scans for the presence and location of laterality‐matched arterial occlusion and/or abnormal collateral score combined into a single measure of arterial abnormality. We tested the diagnostic accuracy of e‐CTA for identifying any arterial abnormality (and in a sensitivity analysis compliant with the manufacturer's guidance that software only be used to assess the anterior circulation).Results: We include CTA from 668 patients (50% female; median: age 71 years, NIHSS 9, 2.3 h from stroke onset). Experts identified arterial occlusion in 365 patients (55%); most (343, 94%) involved the anterior circulation. Software successfully processed 545/668 (82%) CTAs. The sensitivity, specificity and diagnostic accuracy of e‐CTA for detecting arterial abnormality were each 72% (95% CI = 66–77%). Diagnostic accuracy was non‐significantly improved in a sensitivity analysis excluding occlusions from outside the anterior circulation (76%, 95% CI = 72–80%).Interpretation: Compared to experts, the diagnostic accuracy of e‐CTA for identifying acute arterial abnormality was 72–76%. Users of e‐CTA should be competent in CTA interpretation to ensure all potential thrombectomy candidates are identified.Keywords
Funding Information
- Medical Research Council (MC_PC_17188)
- Stroke Association (TSA_CR_2017/01)
- UK Dementia Research Institute
- Alzheimer's Society
This publication has 22 references indexed in Scilit:
- Impact of Mechanical Thrombectomy on the Organization of the Management of Acute Ischemic StrokeEuropean Neurology, 2016
- STARD 2015: An Updated List of Essential Items for Reporting Diagnostic Accuracy StudiesRadiology, 2015
- Association between brain imaging signs, early and late outcomes, and response to intravenous alteplase after acute ischaemic stroke in the third International Stroke Trial (IST-3): secondary analysis of a randomised controlled trialThe Lancet Neurology, 2015
- Alteplase versus tenecteplase for thrombolysis after ischaemic stroke (ATTEST): a phase 2, randomised, open-label, blinded endpoint studyThe Lancet Neurology, 2015
- Effect of treatment delay, age, and stroke severity on the effects of intravenous thrombolysis with alteplase for acute ischaemic stroke: a meta-analysis of individual patient data from randomised trialsThe Lancet, 2014
- Observer reliability of CT angiography in the assessment of acute ischaemic stroke: data from the Third International Stroke TrialNeuroradiology, 2014
- The benefits and harms of intravenous thrombolysis with recombinant tissue plasminogen activator within 6 h of acute ischaemic stroke (the third international stroke trial [IST-3]): a randomised controlled trialThe Lancet, 2012
- The independent predictive utility of computed tomography angiographic collateral status in acute ischaemic strokeBrain, 2009
- CT Angiography Clot Burden Score and Collateral Score: Correlation with Clinical and Radiologic Outcomes in Acute Middle Cerebral Artery InfarctAmerican Journal of Neuroradiology, 2009
- Probable Inference, the Law of Succession, and Statistical InferenceJournal of the American Statistical Association, 1927