Validation of automated Alberta Stroke Program Early CT Score (ASPECTS) software for detection of early ischemic changes on non-contrast brain CT scans
Authors:
- Lennard WolffLWLennard Wolff
- Olvert A. BerkhemerOBOlvert A. Berkhemer
- Adriaan C. G. M. van EsAEAdriaan C. G. M. van Es
- Wim H. van ZwamWZWim H. van Zwam
- Diederik W. J. DippelDDDiederik W. J. Dippel
- Charles B. L. M. MajoieCMCharles B. L. M. Majoie
- Theo van WalsumTWTheo van Walsum
- Aad van der LugtALAad van der Lugt
- for the MR CLEAN InvestigatorsFIfor the MR CLEAN Investigators
Open Access
- 28 August 2020
- journal article
- research article
- Published by Springer Nature in Neuroradiology
- Vol. 63 (4) , 491-498
Abstract
Purpose: In ASPECTS, 10 brain regions are scored visually for presence of acute ischemic stroke damage. We evaluated automated ASPECTS in comparison to expert readers.Methods: Consecutive, baseline non-contrast CT-scans (5-mm slice thickness) from the prospective MR CLEAN trial (n= 459, MR CLEAN Netherlands Trial Registry number: NTR1804) were evaluated. A two-observer consensus for ASPECTS regions (normal/abnormal) was used as reference standard for training and testing (0.2/0.8 division). Two other observers provided individual ASPECTS-region scores. The Automated ASPECTS software was applied. A region score specificity of ≥ 90% was used to determine the software threshold for detection of an affected region based on relative density difference between affected and contralateral region. Sensitivity, specificity, and receiver-operating characteristic curves were calculated. Additionally, we assessed intraclass correlation coefficients (ICCs) for automated ASPECTS and observers in comparison to the reference standard in the test set.Results: In the training set (n= 104), with software thresholds for a specificity of ≥ 90%, we found a sensitivity of 33–49% and an area under the curve (AUC) of 0.741–0.785 for detection of an affected ASPECTS region. In the test set (n= 355), the results for the found software thresholds were 89–89% (specificity), 41–57% (sensitivity), and 0.750–0.795 (AUC). Comparison of automated ASPECTS with the reference standard resulted in an ICC of 0.526. Comparison of observers with the reference standard resulted in an ICC of 0.383–0.464.Conclusion: The performance of automated ASPECTS is comparable to expert readers and could support readers in the detection of early ischemic changes.Keywords
Funding Information
- Hartstichting
- Angiocare BV
- Medtronic
- Covidien
- ev3
- Medac GmbH
- Lamepro
- Penumbra Inc.
- Stryker
- Top Medical
- Concentric
- Hersenstichting
- Health~Holland
- Top Sector Life Sciences
- Cerenovus
This publication has 25 references indexed in Scilit:
- A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability ResearchJournal of Chiropractic Medicine, 2016
- Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patientsInternational Journal of Stroke, 2016
- Gray-Matter Volume Estimate Score: A Novel Semi-Automatic Method Measuring Early Ischemic Change on CTJournal of Stroke, 2016
- Alberta Stroke Program Early Computed Tomographic Scoring Performance in a Series of Patients Undergoing Computed Tomography and MRIStroke, 2015
- Automated brain computed tomographic densitometry of early ischemic changes in acute strokeJournal of Medical Imaging, 2015
- A Randomized Trial of Intraarterial Treatment for Acute Ischemic StrokeNew England Journal of Medicine, 2015
- MR CLEAN, a multicenter randomized clinical trial of endovascular treatment for acute ischemic stroke in the Netherlands: study protocol for a randomized controlled trialTrials, 2014
- Interobserver Reliability of Baseline Noncontrast CT Alberta Stroke Program Early CT Score for Intra-Arterial Stroke Treatment SelectionAmerican Journal of Neuroradiology, 2012
- Hypodensity of >1/3 Middle Cerebral Artery Territory Versus Alberta Stroke Programme Early CT Score (ASPECTS)Stroke, 2003
- Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapyThe Lancet, 2000