Predictors of interobserver agreement in breast imaging using the Breast Imaging Reporting and Data System
- 21 February 2010
- journal article
- review article
- Published by Springer Nature in Breast Cancer Research and Treatment
- Vol. 120 (3) , 539-546
Abstract
The Breast Imaging Reporting and Data System (BI-RADS) was introduced in 1993 to standardize the interpretation of mammograms. Though many studies have assessed the validity of the system, fewer have examined its reliability. Our objective is to identify predictors of reliability as measured by the kappa statistic. We identified studies conducted between 1993 and 2009 which reported kappa values for interpreting mammograms using any edition of BI-RADS. Bivariate and multivariate multilevel analyses were used to examine associations between potential predictors and kappa values. We identified ten eligible studies, which yielded 88 kappa values for the analysis. Potential predictors of kappa included: whether or not the study included negative cases, whether single- or two-view mammograms were used, whether or not mammograms were digital versus screen-film, whether or not the fourth edition of BI-RADS was utilized, the BI-RADS category being evaluated, whether or not readers were trained, whether or not there was an overlap in readers’ professional activities, the number of cases in the study and the country in which the study was conducted. Our best multivariate model identified training, use of two-view mammograms and BI-RADS categories (masses, calcifications, and final assessments) as predictors of kappa. Training, use of two-view mammograms and focusing on mass description may be useful in increasing reliability in mammogram interpretation. Calcification and final assessment descriptors are areas for potential improvement. These findings are important for implementing policies in BI-RADS use before introducing the system in different settings and improving current implementations.Keywords
This publication has 38 references indexed in Scilit:
- Automated Breast Ultrasound: Lesion Detection and BI-RADS™ Classification – a Pilot StudyRöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren, 2008
- Avaliação de microcalcificações mamárias de acordo com as classificações do Breast Imaging Reporting and Data System (BI-RADS TM) e de Le GalRevista Brasileira de Ginecologia e Obstetrícia, 2008
- Value of MRI in the surgical planning of invasive lobular breast carcinoma: a prospective and a retrospective study of 57 casesClinical Imaging, 2007
- Real‐time elastography — an advanced method of ultrasound: first results in 108 patients with breast lesionsUltrasound in Obstetrics & Gynecology, 2006
- The rising burden of cancer in the developing worldAnnals of Oncology, 2006
- The logistic transform for bounded outcome scoresBiostatistics, 2006
- Mammadiagnostische Zweitbefundung in der Radiologischen Klinik: sinnvoller Mehraufwand oder Ressourcenverschwendung?RöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren, 2006
- Diagnostische Mammographie und Sonographie: Korrelation von diagnostischer BI-RADS-Einstufung mit dem histologischen und klinischen EndbefundRöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren, 2005
- Reproducibility of mammographic classifications for non-palpable suspect lesions with microcalcificationsBritish Journal of Radiology, 2004
- Breast imaging reporting and data system standardized mammography lexicon: observer variability in lesion description.American Journal of Roentgenology, 1996