A study of transportability of an existing smoking status detection module across institutions.
Authors:
- 3 November 2012
- journal article
- Vol. 2012, 577-86
Abstract
Electronic Medical Records (EMRs) are valuable resources for clinical observational studies. Smoking status of a patient is one of the key factors for many diseases, but it is often embedded in narrative text. Natural language processing (NLP) systems have been developed for this specific task, such as the smoking status detection module in the clinical Text Analysis and Knowledge Extraction System (cTAKES). This study examined transportability of the smoking module in cTAKES on the Vanderbilt University Hospital's EMR data. Our evaluation demonstrated that modest effort of change is necessary to achieve desirable performance. We modified the system by filtering notes, annotating new data for training the machine learning classifier, and adding rules to the rule-based classifiers. Our results showed that the customized module achieved significantly higher F-measures at all levels of classification (i.e., sentence, document, patient) compared to the direct application of the cTAKES module to the Vanderbilt data.Keywords
This publication has 21 references indexed in Scilit:
- Automated extraction of ejection fraction for quality measurement using regular expressions in Unstructured Information Management Architecture (UIMA) for heart failureJournal of the American Medical Informatics Association, 2012
- Development of a Large-Scale De-Identified DNA Biobank to Enable Personalized MedicineClinical Pharmacology & Therapeutics, 2008
- Identifying Smokers with a Medical Extraction SystemJournal of the American Medical Informatics Association, 2008
- Using Implicit Information to Identify Smoking Status in Smoke-blind Medical Discharge SummariesJournal of the American Medical Informatics Association, 2008
- Medical i2b2 NLP Smoking Challenge: The A-Life System Architecture and MethodologyJournal of the American Medical Informatics Association, 2008
- Mayo Clinic NLP System for Patient Smoking Status IdentificationJournal of the American Medical Informatics Association, 2008
- Five-way Smoking Status Classification Using Text Hot-Spot Identification and Error-correcting Output CodesJournal of the American Medical Informatics Association, 2008
- Identifying Patient Smoking Status from Medical Discharge RecordsJournal of the American Medical Informatics Association, 2008
- "Understanding" Medical School Curriculum Content Using KnowledgeMapJournal of the American Medical Informatics Association, 2003
- Extracting Findings from Narrative Reports: Software Transferability and Sources of Physician DisagreementMethods of Information in Medicine, 1998