Automating the Capture of Structured Pathology Data for Prostate Cancer Clinical Care and Research
- 1 December 2019
- journal article
- research article
- Published by American Society of Clinical Oncology (ASCO) in JCO Clinical Cancer Informatics
- Vol. 3 (3) , 1-8
Abstract
Purpose: Cancer pathology findings are critical for many aspects of care but are often locked away as unstructured free text. Our objective was to develop a natural language processing (NLP) system to extract prostate pathology details from postoperative pathology reports and a parallel structured data entry process for use by urologists during routine documentation care and compare accuracy when compared with manual abstraction and concordance between NLP and clinician-entered approaches. Materials and Methods: From February 2016, clinicians used note templates with custom structured data elements (SDEs) during routine clinical care for men with prostate cancer. We also developed an NLP algorithm to parse radical prostatectomy pathology reports and extract structured data. We compared accuracy of clinician-entered SDEs and NLP-parsed data to manual abstraction as a gold standard and compared concordance (Cohen’s κ) between approaches assuming no gold standard. Results: There were 523 patients with NLP-extracted data, 319 with SDE data, and 555 with manually abstracted data. For Gleason scores, NLP and clinician SDE accuracy was 95.6% and 95.8%, respectively, compared with manual abstraction, with concordance of 0.93 (95% CI, 0.89 to 0.98). For margin status, extracapsular extension, and seminal vesicle invasion, stage, and lymph node status, NLP accuracy was 94.8% to 100%, SDE accuracy was 87.7% to 100%, and concordance between NLP and SDE ranged from 0.92 to 1.0. Conclusion: We show that a real-world deployment of an NLP algorithm to extract pathology data and structured data entry by clinicians during routine clinical care in a busy clinical practice can generate accurate data when compared with manual abstraction for some, but not all, components of a prostate pathology report.Keywords
This publication has 31 references indexed in Scilit:
- Closing the Quality Loop: Facilitating Improvement in Oncology Practice Through Timely Access to Clinical Performance IndicatorsJournal of Oncology Practice, 2013
- Wide coverage biomedical event extraction using multiple partially overlapping corporaBMC Bioinformatics, 2013
- Extracting data from electronic medical records: validation of a natural language processing program to assess prostate biopsy resultsWorld Journal of Urology, 2013
- Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical researchJournal of the American Medical Informatics Association, 2013
- How Good Are the Data? Feasible Approach to Validation of Metrics of Quality Derived From an Outpatient Electronic Health RecordAmerican Journal of Medical Quality, 2011
- Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applicationsJournal of the American Medical Informatics Association, 2010
- Automatically extracting cancer disease characteristics from pathology reports into a Disease Knowledge Representation ModelJournal of Biomedical Informatics, 2009
- Developing a manually annotated clinical document corpus to identify phenotypic information for inflammatory bowel diseaseBMC Bioinformatics, 2009
- A General Natural-language Text Processor for Clinical RadiologyJournal of the American Medical Informatics Association, 1994
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960