Head-to-head comparison of commercial artificial intelligence solutions for detection of large vessel occlusion at a comprehensive stroke center
Open Access
- 10 October 2022
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neurology
- Vol. 13, 1026609
Abstract
Purpose: Despite the availability of commercial artificial intelligence (AI) tools for large vessel occlusion (LVO) detection, there is paucity of data comparing traditional machine learning and deep learning solutions in a real-world setting. The purpose of this study is to compare and validate the performance of two AI-based tools (RAPID LVO and CINA LVO) for LVO detection.Materials and methods: This was a retrospective, single center study performed at a comprehensive stroke center from December 2020 to June 2021. CT angiography (n = 263) for suspected stroke were evaluated for LVO. RAPID LVO is a traditional machine learning model which primarily relies on vessel density threshold assessment, while CINA LVO is an end-to-end deep learning tool implemented with multiple neural networks for detection and localization tasks. Reasons for errors were also recorded.Results: There were 29 positive and 224 negative LVO cases by ground truth assessment. RAPID LVO demonstrated an accuracy of 0.86, sensitivity of 0.90, specificity of 0.86, positive predictive value of 0.45, and negative predictive value of 0.98, while CINA demonstrated an accuracy of 0.96, sensitivity of 0.76, specificity of 0.98, positive predictive value of 0.85, and negative predictive value of 0.97.Conclusion: Both tools successfully detected most anterior circulation occlusions. RAPID LVO had higher sensitivity while CINA LVO had higher accuracy and specificity. Interestingly, both tools were able to detect some, but not all M2 MCA occlusions. This is the first study to compare traditional and deep learning LVO tools in the clinical setting.Keywords
Funding Information
- Canon Medical Systems Corporation
This publication has 13 references indexed in Scilit:
- Single Site performance of AI software for stroke detection and TriagemedRxiv, 2021
- Impact of RapidAI mobile application on treatment times in patients with large vessel occlusionJournal of NeuroInterventional Surgery, 2021
- Early experience utilizing artificial intelligence shows significant reduction in transfer times and length of stay in a hub and spoke modelInterventional Neuroradiology, 2020
- Fast Automatic Detection of Large Vessel Occlusions on CT AngiographyStroke, 2019
- Artificial intelligence to diagnose ischemic stroke and identify large vessel occlusions: a systematic reviewJournal of NeuroInterventional Surgery, 2019
- Association Between Time to Treatment With Endovascular Reperfusion Therapy and Outcomes in Patients With Acute Ischemic Stroke Treated in Clinical PracticeJAMA, 2019
- Ischemic Strokes Due to Large-Vessel Occlusions Contribute Disproportionately to Stroke-Related Dependence and Death: A ReviewFrontiers in Neurology, 2017
- Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trialsThe Lancet, 2016
- Heart Disease and Stroke Statistics—2015 UpdateCirculation, 2015
- Moyamoya disease: current concepts and future perspectivesThe Lancet Neurology, 2008