Clinical uncertainty in large vessel occlusion ischemic stroke: does automated perfusion imaging make a difference? An intra-rater and inter-rater agreement study
- 7 March 2024
- journal article
- research article
- Published by BMJ in Journal of NeuroInterventional Surgery
- Vol. 17 (2) , 192-199
Abstract
Background: Limited research exists regarding the impact of neuroimaging on endovascular thrombectomy (EVT) decisions for late-window cases of large vessel occlusion (LVO) stroke.Objective: T0 assess whether perfusion CT imaging: (1) alters the proportion of recommendations for EVT, and (2) enhances the reliability of EVT decision-making compared with non-contrast CT and CT angiography.Methods: We conducted a survey using 30 patients drawn from an institutional database of 3144 acute stroke cases. These were presented to 29 Canadian physicians with and without perfusion imaging. We used non-overlapping 95% confidence intervals and difference in agreement classification as criteria to suggest a difference between the Gwet AC1 statistics (κG).Results: The percentage of EVT recommendations differed by 1.1% with or without perfusion imaging. Individual decisions changed in 21.4% of cases (11.3% against EVT and 10.1% in favor). Inter-rater agreement (κG) among the 29 raters was similar between non-perfusion and perfusion CT neuroimaging (κG=0.487; 95% CI 0.327 to 0.647 and κG=0.552; 95% CI 0.430 to 0.675). The 95% CIs overlapped with moderate agreement in both. Intra-rater agreement exhibited overlapping 95% CIs for all 28 raters. κGwas either substantial or excellent (0.81–1) for 71.4% (20/28) of raters in both groups.Conclusions: Despite the minimal difference in overall EVT recommendations with either neuroimaging protocol one in five decisions changed with perfusion imaging. Regarding agreement we found that the use of automated CT perfusion images does not significantly impact the reliability of EVT decisions for patients with late-window LVO.Keywords
Funding Information
- McMaster University/ Fergus Mills Scholarship (NA)
This publication has 33 references indexed in Scilit:
- Endovascular treatment versus no endovascular treatment after 6–24 h in patients with ischaemic stroke and collateral flow on CT angiography (MR CLEAN-LATE) in the Netherlands: a multicentre, open-label, blinded-endpoint, randomised, controlled, phase 3 trialThe Lancet, 2023
- Inter–rater reliability of the simplified Modified Rankin Scale as an outcome measure for treated cerebral aneurysm patientsNeurochirurgie, 2022
- Noncontrast Computed Tomography vs Computed Tomography Perfusion or Magnetic Resonance Imaging Selection in Late Presentation of Stroke With Large-Vessel OcclusionJAMA Neurology, 2021
- Comparison of multimodal CT scan protocols used for decision-making on mechanical thrombectomy in acute ischemic strokeNeuroradiology, 2020
- The REDCap consortium: Building an international community of software platform partnersJournal of Biomedical Informatics, 2019
- Penumbral imaging and functional outcome in patients with anterior circulation ischaemic stroke treated with endovascular thrombectomy versus medical therapy: a meta-analysis of individual patient-level dataThe Lancet Neurology, 2019
- Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposedJournal of Clinical Epidemiology, 2011
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- High agreement but low kappa: II. Resolving the paradoxesJournal of Clinical Epidemiology, 1990
- High agreement but low Kappa: I. the problems of two paradoxesJournal of Clinical Epidemiology, 1990