Using Natural Language Processing of Free-Text Radiology Reports to Identify Type 1 Modic Endplate Changes
Authors:
- 14 August 2017
- journal article
- research article
- Published by Springer Nature in Journal of Digital Imaging
- Vol. 31 (1) , 84-90
Abstract
Electronic medical record (EMR) systems provide easy access to radiology reports and offer great potential to support quality improvement efforts and clinical research. Harnessing the full potential of the EMR requires scalable approaches such as natural language processing (NLP) to convert text into variables used for evaluation or analysis. Our goal was to determine the feasibility of using NLP to identify patients with Type 1 Modic endplate changes using clinical reports of magnetic resonance (MR) imaging examinations of the spine. Identifying patients with Type 1 Modic change who may be eligible for clinical trials is important as these findings may be important targets for intervention. Four annotators identified all reports that contained Type 1 Modic change, using N = 458 randomly selected lumbar spine MR reports. We then implemented a rule-based NLP algorithm in Java using regular expressions. The prevalence of Type 1 Modic change in the annotated dataset was 10%. Results were recall (sensitivity) 35/50 = 0.70 (95% confidence interval (C.I.) 0.52–0.82), specificity 404/408 = 0.99 (0.97–1.0), precision (positive predictive value) 35/39 = 0.90 (0.75–0.97), negative predictive value 404/419 = 0.96 (0.94–0.98), and F1-score 0.79 (0.43–1.0). Our evaluation shows the efficacy of rule-based NLP approach for identifying patients with Type 1 Modic change if the emphasis is on identifying only relevant cases with low concern regarding false negatives. As expected, our results show that specificity is higher than recall. This is due to the inherent difficulty of eliciting all possible keywords given the enormous variability of lumbar spine reporting, which decreases recall, while availability of good negation algorithms improves specificity.Keywords
Funding Information
- National Institutes of Health (1UH2AT007766-01, 4UH3AR066795-02)
- ClinicalTrials.gov (NCT02015455)
This publication has 17 references indexed in Scilit:
- Back pain in seniors: the Back pain Outcomes using Longitudinal Data (BOLD) cohort baseline dataBMC Musculoskeletal Disorders, 2014
- The Role of Balanced Training and Testing Data Sets for Binary Classifiers in BioinformaticsPLOS ONE, 2013
- Automated Detection of Critical Results in Radiology ReportsJournal of Digital Imaging, 2011
- The ACR BI-RADS® Experience: Learning From HistoryJournal of the American College of Radiology, 2009
- Structured Radiology Reporting: Are We There Yet?Radiology, 2009
- ConText: An algorithm for determining negation, experiencer, and temporal status from clinical reportsJournal of Biomedical Informatics, 2009
- Discerning Tumor Status from Unstructured MRI Reports—Completeness of Information in Existing Reports and Utility of Automated Natural Language ProcessingJournal of Digital Imaging, 2009
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- Vertebral endplate signal changes (Modic change): a systematic literature review of prevalence and association with non-specific low back painEuropean Spine Journal, 2008
- A Simple Algorithm for Identifying Negated Findings and Diseases in Discharge SummariesJournal of Biomedical Informatics, 2001