Automated Extraction of Grade, Stage, and Quality Information From Transurethral Resection of Bladder Tumor Pathology Reports Using Natural Language Processing
Authors:
- 1 December 2018
- journal article
- research article
- Published by American Society of Clinical Oncology (ASCO) in JCO Clinical Cancer Informatics
- Vol. 2 (2) , 1-8
Abstract
Purpose: Bladder cancer is initially diagnosed and staged with a transurethral resection of bladder tumor (TURBT). Patient survival is dependent on appropriate sampling of layers of the bladder, but pathology reports are dictated as free text, making large-scale data extraction for quality improvement challenging. We sought to automate extraction of stage, grade, and quality information from TURBT pathology reports using natural language processing (NLP). Methods: Patients undergoing TURBT were retrospectively identified using the Northwestern Enterprise Data Warehouse. An NLP algorithm was then created to extract information from free-text pathology reports and was iteratively improved using a training set of manually reviewed TURBTs. NLP accuracy was then validated using another set of manually reviewed TURBTs, and reliability was calculated using Cohen’s κ. Results: Of 3,042 TURBTs identified from 2006 to 2016, 39% were classified as benign, 35% as Ta, 11% as T1, 4% as T2, and 10% as isolated carcinoma in situ. Of 500 randomly selected manually reviewed TURBTs, NLP correctly staged 88% of specimens (κ = 0.82; 95% CI, 0.78 to 0.86). Of 272 manually reviewed T1 tumors, NLP correctly categorized grade in 100% of tumors (κ = 1), correctly categorized if muscularis propria was reported by the pathologist in 98% of tumors (κ = 0.81; 95% CI, 0.62 to 0.99), and correctly categorized if muscularis propria was present or absent in the resection specimen in 82% of tumors (κ = 0.62; 95% CI, 0.55 to 0.73). Discrepancy analysis revealed pathologist notes and deeper resection specimens as frequent reasons for NLP misclassifications. Conclusion: We developed an NLP algorithm that demonstrates a high degree of reliability in extracting stage, grade, and presence of muscularis propria from TURBT pathology reports. Future iterations can continue to improve performance, but automated extraction of oncologic information is promising in improving quality and assisting physicians in delivery of care.Keywords
This publication has 19 references indexed in Scilit:
- Detrusor Muscle in TUR-Derived Bladder Tumor Specimens: Can We Actually Improve the Surgical Quality?Journal of Endourology, 2016
- The Economics of Bladder Cancer: Costs and Considerations of Caring for This DiseaseEuropean Urology, 2014
- Use of Restaging Bladder Tumor Resection for Bladder Cancer Among Medicare BeneficiariesUrology, 2011
- Regional Differences in Early Stage Bladder Cancer Care and OutcomesUrology, 2010
- Impact of Routine Second Transurethral Resection on the Long-Term Outcome of Patients with Newly Diagnosed pT1 Urothelial Carcinoma with Respect to Recurrence, Progression Rate, and Disease-Specific Survival: A Prospective Randomised Clinical TrialEuropean Urology, 2010
- Understanding the variation in treatment intensity among patients with early stage bladder cancerCancer, 2010
- Patterns of care for early stage bladder cancerCancer, 2010
- Clinical Outcome in a Contemporary Series of Restaged Patients with Clinical T1 Bladder CancerEuropean Urology, 2009
- Provider Treatment Intensity and Outcomes for Patients With Early-Stage Bladder CancerJNCI: Journal of the National Cancer Institute, 2009
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960