Does Training in the Breast Imaging Reporting and Data System (BI-RADS) Improve Biopsy Recommendations or Feature Analysis Agreement with Experienced Breast Imagers at Mammography?
Authors:
- Wendie A. BergWBWendie A. Berg
- Carl J. D’oRsiCDCarl J. D’oRsi
- Valerie P. JacksonVJValerie P. Jackson
- Lawrence W. BassettLBLawrence W. Bassett
- Craig A. BeamCBCraig A. Beam
- Rebecca S. LewisRLRebecca S. Lewis
- Philip E. CrewsonPCPhilip E. Crewson
- 1 September 2002
- journal article
- Published by Radiological Society of North America (RSNA) in Radiology
- Vol. 224 (3) , 871-880
Abstract
To determine whether training in the Breast Imaging Reporting and Data System (BI-RADS) improves observer performance and agreement with the consensus of experienced breast imagers with regard to mammographic feature analysis and final assessment. A test set of mammograms was developed, with 54 proven lesions consisting of 28 masses (nine [32%] malignancies) and 26 microcalcifications (10 [38%] malignancies). Three experienced breast imagers reviewed cases independently and by means of consensus. Twenty-three practicing mammogram-interpreting physicians reviewed mammograms before and after a day's lectures on BI-RADS. Observer performance before and after training was measured by means of agreement (kappa) with consensus description and assessments, rate of biopsy of malignant and benign lesions, and areas under receiver operating characteristic (ROC) curves. Performance was also measured for 11 participants 2-3 months after training. Improved agreement with consensus feature analysis was found for mass margins and/or asymmetries, with a pretraining generalized kappa value of 0.36 and a posttraining generalized kappa value of 0.41. Similar improvement was seen for description of calcification morphology (pretraining kappa value of 0.36 improving to 0.44 after training). No improvement was seen in describing calcification distribution. Final assessments were more consistent after training, with a pretraining kappa value of 0.31, as compared with 0.45 after training. The mean biopsy rate for malignant lesions improved from 73% (range, 53%-89%) before training to 88% (range, 74%-100%) after training, with minimal increase in mean biopsy rate of benign lesions (43% [range, 26%-60%] before to 51% [range, 31%-63%] after training), and no net change in area under the ROC curve, as compared with histopathologic findings. For the subset of participants with delayed follow-up, no significant decline in posttraining results was seen. BI-RADS training resulted in improved agreement with the consensus of experienced breast imagers for feature analysis and final assessment. It is important that trainees showed improved rates of recommending biopsy for malignant lesions. This effect was maintained over 2-3 months.Keywords
This publication has 34 references indexed in Scilit:
- The breast imaging reporting and data system: positive predictive value of mammographic features and final assessment categories.American Journal of Roentgenology, 1998
- Variability in the Interpretation of Screening Mammograms by US RadiologistsArchives of internal medicine (1960), 1996
- A proposal for a national mammography database: content, purpose, and value.American Journal of Roentgenology, 1995
- The Accuracy of Mammographic InterpretationNew England Journal of Medicine, 1994
- Variability in Radiologists' Interpretations of MammogramsNew England Journal of Medicine, 1994
- Nonpalpable, circumscribed, noncalcified solid breast masses: likelihood of malignancy based on lesion size and age of patient.Radiology, 1994
- Mammographic feature analysisSeminars in Roentgenology, 1993
- Periodic mammographic follow-up of probably benign lesions: results in 3,184 consecutive cases.Radiology, 1991
- ROC Methodology in Radiologic ImagingInvestigative Radiology, 1986
- Measuring nominal scale agreement among many raters.Psychological Bulletin, 1971