Efficient identification of nationally mandated reportable cancer cases using natural language processing and machine learning
Open Access
- 28 March 2016
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 23 (6) , 1077-1084
Abstract
Objective To help cancer registrars efficiently and accurately identify reportable cancer cases. Material and Methods The Cancer Registry Control Panel (CRCP) was developed to detect mentions of reportable cancer cases using a pipeline built on the Unstructured Information Management Architecture – Asynchronous Scaleout (UIMA-AS) architecture containing the National Library of Medicine’s UIMA MetaMap annotator as well as a variety of rule-based UIMA annotators that primarily act to filter out concepts referring to nonreportable cancers. CRCP inspects pathology reports nightly to identify pathology records containing relevant cancer concepts and combines this with diagnosis codes from the Clinical Electronic Data Warehouse to identify candidate cancer patients using supervised machine learning. Cancer mentions are highlighted in all candidate clinical notes and then sorted in CRCP’s web interface for faster validation by cancer registrars. Results CRCP achieved an accuracy of 0.872 and detected reportable cancer cases with a precision of 0.843 and a recall of 0.848. CRCP increases throughput by 22.6% over a baseline (manual review) pathology report inspection system while achieving a higher precision and recall. Depending on registrar time constraints, CRCP can increase recall to 0.939 at the expense of precision by incorporating a data source information feature. Conclusion CRCP demonstrates accurate results when applying natural language processing features to the problem of detecting patients with cases of reportable cancer from clinical notes. We show that implementing only a portion of cancer reporting rules in the form of regular expressions is sufficient to increase the precision, recall, and speed of the detection of reportable cancer cases when combined with off-the-shelf information extraction software and machine learning.Keywords
This publication has 10 references indexed in Scilit:
- Text mining of cancer-related information: Review of current status and future directionsInternational Journal of Medical Informatics, 2014
- Extracting and integrating data from entire electronic health records for detecting colorectal cancer cases.2011
- Comparing methods for identifying pancreatic cancer patients using electronic data sources.2010
- Pattern-based information extraction from pathology reports for cancer registrationCancer Causes & Control, 2010
- Symbolic rule-based classification of lung cancer stages from free-text pathology reportsJournal of the American Medical Informatics Association, 2010
- An overview of MetaMap: historical perspective and recent advancesJournal of the American Medical Informatics Association, 2010
- Automatically extracting cancer disease characteristics from pathology reports into a Disease Knowledge Representation ModelJournal of Biomedical Informatics, 2009
- Facilitating cancer research using natural language processing of pathology reports.2004
- The Unified Medical Language System (UMLS): integrating biomedical terminologyNucleic Acids Research, 2004
- Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program.2001