Interrater Agreement in the Evaluation of Discrepant Imaging Findings With the Radpeer System
Authors:
- 1 December 2012
- journal article
- Published by American Roentgen Ray Society in American Journal of Roentgenology
- Vol. 199 (6) , 1320-1327
Abstract
OBJECTIVE. The Radpeer system is central to the quality assurance process in many radiology practices. Previous studies have shown poor agreement between physicians in the evaluation of their peers. The purpose of this study was to assess the reliability of the Radpeer scoring system. MATERIALS AND METHODS. A sample of 25 discrepant cases was extracted from our quality assurance database. Images were made anonymous; associated reports and identities of interpreting radiologists were removed. Indications for the studies and descriptions of the discrepancies were provided. Twenty-one subspecialist attending radiologists rated the cases using the Radpeer scoring system. Multirater kappa statistics were used to assess interrater agreement, both with the standard scoring system and with dichotomized scores to reflect the practice of further review for cases rated 3 and 4. Subgroup analyses were conducted to assess subspecialist evaluation of cases. RESULTS. Interrater agreement was slight to fair compared with...Keywords
This publication has 27 references indexed in Scilit:
- Peer Review in Diagnostic Radiology: Current State and a Vision for the FutureRadioGraphics, 2009
- Anonymous group peer review in surgery morbidity and mortality conferenceThe American Journal of Surgery, 2009
- Developing a Radiology Quality and Safety Program: A PrimerRadioGraphics, 2009
- Agreement between an isolated rater and a group of ratersStatistica Neerlandica, 2009
- RADPEER™ Scoring White PaperJournal of the American College of Radiology, 2009
- Accuracy of Diagnostic Procedures: Has It Improved Over the Past Five Decades?American Journal of Roentgenology, 2007
- Quality—A Radiology Imperative: Interpretation Accuracy and PertinenceJournal of the American College of Radiology, 2007
- RADPEER quality assurance program: a multifacility study of interpretive disagreement ratesJournal of the American College of Radiology, 2004
- The Reliability of Peer AssessmentsEvaluation & the Health Professions, 1994
- Measuring nominal scale agreement among many raters.Psychological Bulletin, 1971