Toward Electronic Surveillance of Invasive Mold Diseases in Hematology-Oncology Patients: An Expert System Combining Natural Language Processing of Chest Computed Tomography Reports, Microbiology, and Antifungal Drug Data
- 1 November 2017
- journal article
- research article
- Published by American Society of Clinical Oncology (ASCO) in JCO Clinical Cancer Informatics
- Vol. 1 (1) , 1-10
Abstract
Purpose: Prospective epidemiologic surveillance of invasive mold disease (IMD) in hematology patients is hampered by the absence of a reliable laboratory prompt. This study develops an expert system for electronic surveillance of IMD that combines probabilities using natural language processing (NLP) of computed tomography (CT) reports with microbiology and antifungal drug data to improve prediction of IMD. Methods: Microbiology indicators and antifungal drug–dispensing data were extracted from hospital information systems at three tertiary hospitals for 123 hematology-oncology patients. Of this group, 64 case patients had 26 probable/proven IMD according to international definitions, and 59 patients were uninfected controls. Derived probabilities from NLP combined with medical expertise identified patients at high likelihood of IMD, with remaining patients processed by a machine-learning classifier trained on all available features. Results: Compared with the baseline text classifier, the expert system that incorporated the best performing algorithm (naïve Bayes) improved specificity from 50.8% (95% CI, 37.5% to 64.1%) to 74.6% (95% CI, 61.6% to 85.0%), reducing false positives by 48% from 29 to 15; improved sensitivity slightly from 96.9% (95% CI, 89.2% to 99.6%) to 98.4% (95% CI, 91.6% to 100%); and improved receiver operating characteristic area from 73.9% (95% CI, 67.1% to 80.6%) to 92.8% (95% CI, 88% to 97.5%). Conclusion: An expert system that uses multiple sources of data (CT reports, microbiology, antifungal drug dispensing) is a promising approach to continuous prospective surveillance of IMD in the hospital, and demonstrates reduced false notifications (positives) compared with NLP of CT reports alone. Our expert system could provide decision support for IMD surveillance, which is critical to antifungal stewardship and improving supportive care in cancer.Keywords
This publication has 31 references indexed in Scilit:
- Using the Electronic Medical Record to Identify Community-Acquired Pneumonia: Toward a Replicable Automated StrategyPLOS ONE, 2013
- Epidemiology, outcomes, and mortality predictors of invasive mold infections among transplant recipients: a 10‐year, single‐center experienceTransplant Infectious Disease, 2013
- Epidemiological trends in invasive aspergillosis in France: the SAIF network (2005–2007)Clinical Microbiology and Infection, 2011
- Comparative clinical effectiveness of prophylactic voriconazole/posaconazole to fluconazole/itraconazole in patients with acute myeloid leukemia/myelodysplastic syndrome undergoing cytotoxic chemotherapy over a 12-year periodHaematologica, 2011
- Invasive aspergillosis in patients with hematologic malignancies: incidence and description of 127 cases enrolled in a single institution prospective survey from 2004 to 2009Haematologica, 2011
- Attributable Hospital Cost and Antifungal Treatment of Invasive Fungal Diseases in High-Risk Hematology Patients: an Economic Modeling ApproachAntimicrobial Agents and Chemotherapy, 2011
- Impact of invasive fungal disease on the chemotherapy schedule and event-free survival in acute leukemia patients who survived fungal disease: a case-control studyHaematologica, 2010
- Guidelines for Preventing Infectious Complications among Hematopoietic Cell Transplantation Recipients: A Global PerspectiveTransplantation and Cellular Therapy, 2009
- Revised Definitions of Invasive Fungal Disease from the European Organization for Research and Treatment of Cancer/Invasive Fungal Infections Cooperative Group and the National Institute of Allergy and Infectious Diseases Mycoses Study Group (EORTC/MSG) Consensus GroupClinical Infectious Diseases, 2008
- Comparison of the Use of Administrative Data and an Active System for Surveillance of Invasive AspergillosisInfection Control & Hospital Epidemiology, 2008