Carotid Plaque-RADS: Inter- and Intrareader Agreement and Learning Curve Analysis in CTA
- 7 April 2025
- journal article
- Published by American Society of Neuroradiology (ASNR) in American Journal of Neuroradiology
- Vol. 46 (10) , 2009-2017
Abstract
BACKGROUND AND PURPOSE: Atherosclerotic disease of the carotid arteries is a major cause of ischemic stroke. Traditionally, the degree of stenosis has been regarded as the primary parameter for predicting stroke risk, but emerging evidence highlights the importance of carotid plaque composition and morphology. Recently, the Carotid Plaque-Reporting and Data System (RADS) has been introduced to standardize carotid plaque assessment beyond the degree of carotid stenosis. However, its reliability in routine radiologic practice has yet to be established. This study assesses the interreader agreement, intrareader agreement, and learning curve associated with Carotid Plaque-RADS. MATERIALS AND METHODS: In this retrospective study, 500 subjects who underwent CTA for suspected carotid atherosclerosis were assessed. Three readers with varying experience levels in vascular imaging independently evaluated all CTAs in 5 blocks by using Carotid Plaque-RADS. To assess the impact of reader experience and potential improvement over time, interreader agreement between the 3 pairs of readers was calculated for each block by using Cohen κ, enabling a comparison of agreement sequentially across the blocks. Intrareader agreement was calculated on a random block of 100 patients (192 carotid arteries). RESULTS: After exclusion of low-quality examinations, 490 patients were selected for analysis, but 46 carotid arteries were excluded due to previous revascularization procedures. The remaining 934 carotid arteries were assessed. The agreement was substantial between expert and intermediate readers, ranging from κ = 0.78 to κ = 0.88, moderate between intermediate and beginner readers, ranging from κ = 0.50 to κ = 0.74, and between expert and beginner improved from substantial (κ = 0.68) to almost optimal (κ = 0.86) across blocks, indicating the effect of a learning curve. The interreader percent agreement was best for Plaque-RADS category 1, 2, and 3 and poorest for 4. Intrareader agreement was substantial for the beginner (κ = 0.77) and almost perfect for both the intermediate and expert readers (κ = 0.88). CONCLUSIONS: In the CTA application of the Carotid Plaque-RADS, interreader agreement is substantial to near perfect among experienced and intermediate readers, with a notable learning curve for beginners. Intrareader agreement is almost perfect in experienced and intermediate readers, indicating consistency of their grading, ensuring data reproducibility by using Carotid Plaque-RADS.Keywords
This publication has 25 references indexed in Scilit:
- Embolic strokes of undetermined source: a clinical consensus statement of the ESC Council on Stroke, the European Association of Cardiovascular Imaging and the European Heart Rhythm Association of the ESCEuropean Heart Journal, 2024
- Carotid Plaque-RADSJACC: Cardiovascular Imaging, 2023
- Differences in left and right carotid plaque vulnerability in patients with bilateral carotid plaques: a CARE-II studyStroke and Vascular Neurology, 2023
- Imaging biomarkers of vulnerable carotid plaques for stroke risk prediction and their potential clinical implicationsThe Lancet Neurology, 2019
- Sex Differences in Prevalence of and Risk Factors for Carotid Plaque among Adults: A Population-based Cross-Sectional Study in Rural ChinaScientific Reports, 2016
- Age-associated changes in human carotid atherosclerotic plaquesAnnals of Medicine, 2016
- Prevalence of Nonstenosing, Complicated Atherosclerotic Plaques in Cryptogenic StrokeJACC: Cardiovascular Imaging, 2012
- Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposedJournal of Clinical Epidemiology, 2011
- Comparison Between Quantification Methods of Carotid Artery Stenosis and Computed Tomographic AngiographyJournal of Computer Assisted Tomography, 2010
- In vivo accuracy of multisequence MR imaging for identifying unstable fibrous caps in advanced human carotid plaquesJournal of Magnetic Resonance Imaging, 2003