Real world validation of an AI-based CT hemorrhage detection tool
Authors:
Open Access
- 3 August 2023
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neurology
- Vol. 14, 1177723
Abstract
Introduction: Intracranial hemorrhage (ICH) is a potentially life-threatening medical event that requires expedited diagnosis with computed tomography (CT). Automated medical imaging triaging tools can rapidly bring scans containing critical abnormalities, such as ICH, to the attention of radiologists and clinicians. Here, we retrospectively investigated the real-world performance of VeriScout™, an artificial intelligence-based CT hemorrhage detection and triage tool.Methods: Ground truth for the presence or absence of ICH was iteratively determined by expert consensus in an unselected dataset of 527 consecutively acquired non-contrast head CT scans, which were sub-grouped according to the presence of artefact, post-operative features and referral source. The performance of VeriScout™ was compared with the ground truths for all groups.Results: VeriScout™ detected hemorrhage with a sensitivity of 0.92 (CI 0.84–0.96) and a specificity of 0.96 (CI 0.94–0.98) in the global dataset, exceeding the sensitivity of general radiologists (0.88) with only a minor relative decrement in specificity (0.98). Crucially, the AI tool detected 13/14 cases of subarachnoid hemorrhage, a potentially fatal condition that is often missed in emergency department settings. There was no decrement in the performance of VeriScout™ in scans containing artefact or postoperative change. Using an integrated informatics platform, VeriScout™ was deployed into the existing radiology workflow. Detected hemorrhage cases were flagged in the hospital radiology information system (RIS) and relevant, annotated, preview images made available in the picture archiving and communications system (PACS) within 10 min.Conclusion: AI-based radiology worklist prioritization for critical abnormalities, such as ICH, may enhance patient care without adding to radiologist or clinician burden.Keywords
This publication has 20 references indexed in Scilit:
- 24/7/365 Neuroradiologist Coverage Improves Resident Perception of Educational Experience, Referring Physician Satisfaction, and Turnaround TimeCurrent Problems in Diagnostic Radiology, 2020
- Precise diagnosis of intracranial hemorrhage and subtypes using a three-dimensional joint convolutional and recurrent neural networkEuropean Radiology, 2019
- Can emergency physicians accurately interpret computed tomography scans performed for suspected nontraumatic subarachnoid haemorrhage: a cross-sectional studyEuropean Journal of Emergency Medicine, 2018
- Intracerebral haemorrhage: current approaches to acute managementThe Lancet, 2018
- The Effects of Changes in Utilization and Technological Advancements of Cross-Sectional Imaging on Radiologist WorkloadAcademic Radiology, 2015
- LP or not LP, that is the question: gold standard or unnecessary procedure in subarachnoid haemorrhage?Emergency Medicine Journal, 2013
- Incidence, case fatality, and functional outcome of intracerebral haemorrhage over time, according to age, sex, and ethnic origin: a systematic review and meta-analysisThe Lancet Neurology, 2010
- Evaluation of Emergency CT Scans of the Head: Is There a Community Standard?American Journal of Roentgenology, 2003
- Radiology Resident Evaluation of Head CT Scan Orders in the Emergency Department2002
- Resident Interpretation of Emergency Computed Tomographic ScansInvestigative Radiology, 1991