e-ASPECTS software improves interobserver agreement and accuracy of interpretation of aspects score
- 14 April 2021
- journal article
- research article
- Published by SAGE Publications in Interventional Neuroradiology
- Vol. 27 (6) , 781-787
Abstract
Introduction: There is increased interest in the use of artificial intelligence-based (AI) software packages in the evaluation of neuroimaging studies for acute ischemic stroke. We studied whether, compared to standard image interpretation without AI, Brainomix e-ASPECTS software improved interobserver agreement and accuracy in detecting ASPECTS regions affected in anterior circulation LVO. Methods: We included 60 consecutive patients with anterior circulation LVO who had TICI 3 revascularization within 60 minutes of their baseline CT. A total of 16 readers, including senior neuroradiologists, junior neuroradiologists and vascular neurologists participated. Readers interpreted CT scans on independent workstations and assessed final ASPECTS and evaluated whether each individual ASPECTS region was affected. Two months later, readers again evaluated the CT scans, but with assistance of e-ASPECTS software. We assessed interclass correlation coefficient for total ASPECTS and interobserver agreement with Fleiss’ Kappa for each ASPECTS region with and without assistance of the e-ASPECTS. We also assessed accuracy for the readers with and without e-ASPECTS assistance. In our assessment of accuracy, ground truth was the 24 hour CT in this cohort of patients who had prompt and complete revascularization. Results: Interclass correlation coefficient for total ASPECTS without e-ASPECTS assistance was 0.395, indicating fair agreement compared, to 0.574 with e-ASPECTS assistance, indicating good agreement (P < 0.01). There was significant improvement in inter-rater agreement with e-ASPECTS assistance for each individual region with the exception of M6 and caudate. The e-ASPECTS software had higher accuracy than the overall cohort of readers (with and without e-ASPECTS assistance) for every region except the caudate. Conclusions: Use of Brainomix e-ASPECTS software resulted in significant improvements in inter-rater agreement and accuracy of ASPECTS score evaluation in a large group of neuroradiologists and neurologists. e-ASPECTS software was more predictive of final infarct/ASPECTS than the overall group interpreting the CT scans with and without e-ASPECTS assistance.Keywords
This publication has 17 references indexed in Scilit:
- Early CT changes in patients admitted for thrombectomyNeurology, 2016
- Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trialsThe Lancet, 2016
- Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patientsInternational Journal of Stroke, 2016
- Stent-Retriever Thrombectomy after Intravenous t-PA vs. t-PA Alone in StrokeNew England Journal of Medicine, 2015
- Thrombectomy within 8 Hours after Symptom Onset in Ischemic StrokeNew England Journal of Medicine, 2015
- Randomized Assessment of Rapid Endovascular Treatment of Ischemic StrokeNew England Journal of Medicine, 2015
- Endovascular Therapy for Ischemic Stroke with Perfusion-Imaging SelectionNew England Journal of Medicine, 2015
- A Randomized Trial of Intraarterial Treatment for Acute Ischemic StrokeNew England Journal of Medicine, 2015
- Interobserver Reliability of Baseline Noncontrast CT Alberta Stroke Program Early CT Score for Intra-Arterial Stroke Treatment SelectionAmerican Journal of Neuroradiology, 2012
- Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapyThe Lancet, 2000