Using Natural Language Processing to Extract Abnormal Results From Cancer Screening Reports
- 1 September 2017
- journal article
- research article
- Published by Wolters Kluwer Health in Journal of Patient Safety
- Vol. 13 (3) , 138-143
Abstract
Objectives: Numerous studies show that follow-up of abnormal cancer screening results, such as mammography and Papanicolaou (Pap) smears, is frequently not performed in a timely manner. A contributing factor is that abnormal results may go unrecognized because they are buried in free-text documents in electronic medical records (EMRs), and, as a result, patients are lost to follow-up. By identifying abnormal results from free-text reports in EMRs and generating alerts to clinicians, natural language processing (NLP) technology has the potential for improving patient care. The goal of the current study was to evaluate the performance of NLP software for extracting abnormal results from free-text mammography and Pap smear reports stored in an EMR. Methods: A sample of 421 and 500 free-text mammography and Pap reports, respectively, were manually reviewed by a physician, and the results were categorized for each report. We tested the performance of NLP to extract results from the reports. The 2 assessments (criterion standard versus NLP) were compared to determine the precision, recall, and accuracy of NLP. Results: When NLP was compared with manual review for mammography reports, the results were as follows: precision, 98% (96%–99%); recall, 100% (98%–100%); and accuracy, 98% (96%–99%). For Pap smear reports, the precision, recall, and accuracy of NLP were all 100%. Conclusions: Our study developed NLP models that accurately extract abnormal results from mammography and Pap smear reports. Plans include using NLP technology to generate real-time alerts and reminders for providers to facilitate timely follow-up of abnormal results.Keywords
This publication has 35 references indexed in Scilit:
- Clinical decision support with automated text processing for cervical cancer screeningJournal of the American Medical Informatics Association, 2012
- Failure to Follow-Up Test Results for Ambulatory Patients: A Systematic ReviewJournal of General Internal Medicine, 2011
- Automated Detection of Critical Results in Radiology ReportsJournal of Digital Imaging, 2011
- Computerized clinical decision support systems for primary preventive care: A decision-maker-researcher partnership systematic review of effects on process of care and patient outcomesImplementation Science, 2011
- Defining Health Information Technology–Related ErrorsArchives of internal medicine (1960), 2011
- Improving Communication of Diagnostic Radiology Findings through Structured ReportingRadiology, 2011
- Understanding the management of electronic test result notifications in the outpatient settingBMC Medical Informatics and Decision Making, 2011
- Ten Strategies to Improve Management of Abnormal Test Result Alerts in the Electronic Health RecordJournal of Patient Safety, 2010
- What can natural language processing do for clinical decision support?Journal of Biomedical Informatics, 2009
- The frequency of missed test results and associated treatment delays in a highly computerized health systemBMC Family Practice, 2007