Automated Computer-Assisted Categorization of Radiology Reports
Authors:
- Hugue OuelletteHOHugue Ouellette
- Elkan F. HalpernEHElkan F. Halpern
- Daniel I. RosenthalDRDaniel I. Rosenthal
- 1 February 2005
- journal article
- Published by American Roentgen Ray Society in American Journal of Roentgenology
- Vol. 184 (2) , 687-690
Abstract
OBJECTIVE. The objective of our study was to create and validate an automated computerized method for the categorization of narrative text radiograph reports. MATERIALS AND METHODS. Using commercially available software with embedded Boolean logic, we created a text search algorithm to categorize reports of radiography examinations into “fracture,” “normal,” and “neither normal nor fracture.” The algorithm was refined and optimized through repeated testing on 512 consecutive ankle radiography reports from a single clinical imaging center. The final algorithm was applied on a different set of 750 consecutive radiography reports of the spine and extremities produced at three different clinical imaging sites and interpreted by 44 different radiologists. Expert reviewers assessed the accuracy of the final classification. The chi-square test or Fisher's exact test was performed to determine the reproducibility of results across different clinical imaging sites. RESULTS. The computerized classification was highly accurate for the classification of radiography reports into “normal” (specificity, 91.6%; sensitivity, 91.3%), “neither normal nor fracture” (sensitivity, 87.8%; specificity, 94.9%), and “fracture” (sensitivity, 94.1%; specificity, 98.1%) categories. This performance showed no significant difference across the three sites (p > 0.05). CONCLUSION. Computerized categorization of narrative-text radiography reports is highly sensitive and specific and can be used to classify reports from different imaging sites generated by different radiologists. This method can be an extremely powerful tool in future cost-effectiveness studies, health care policy studies, operations assessments, and quality control.Keywords
This publication has 17 references indexed in Scilit:
- Use of Natural Language Processing to Translate Clinical Information from a Database of 889,921 Chest Radiographic ReportsRadiology, 2002
- A Comparison of Classification Algorithms to Automatically Identify Chest X-Ray Reports That Support PneumoniaJournal of Biomedical Informatics, 2001
- Automatic Structuring of Radiology Free-Text ReportsRadioGraphics, 2001
- Automatic Detection of Acute Bacterial Pneumonia from Chest X-ray ReportsJournal of the American Medical Informatics Association, 2000
- Unlocking Clinical Data from Narrative Reports: A Study of Natural Language ProcessingAnnals of Internal Medicine, 1995
- A General Natural-language Text Processor for Clinical RadiologyJournal of the American Medical Informatics Association, 1994
- Natural Language Processing and the Representation of Clinical DataJournal of the American Medical Informatics Association, 1994
- Monitoring Free-Text Data Using Medical Language ProcessingComputers and Biomedical Research, 1993
- Automated analysis of medical text I. Clue gatheringJournal of Medical Systems, 1990
- Computerized extraction of coded findings from free-text radiologic reports. Work in progress.Radiology, 1990