Identification of Prediabetes Discussions in Unstructured Clinical Documentation: Validation of a Natural Language Processing Algorithm
Open Access
- 24 February 2022
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Medical Informatics
- Vol. 10 (2) , e29803
Abstract
Background: Prediabetes affects 1 in 3 US adults. Most are not receiving evidence-based interventions, so understanding how providers discuss prediabetes with patients will inform how to improve their care. Objective: This study aimed to develop a natural language processing (NLP) algorithm using machine learning techniques to identify discussions of prediabetes in narrative documentation. Methods: We developed and applied a keyword search strategy to identify discussions of prediabetes in clinical documentation for patients with prediabetes. We manually reviewed matching notes to determine which represented actual prediabetes discussions. We applied 7 machine learning models against our manual annotation. Results: Machine learning classifiers were able to achieve classification results that were close to human performance with up to 98% precision and recall to identify prediabetes discussions in clinical documentation. Conclusions: We demonstrated that prediabetes discussions can be accurately identified using an NLP algorithm. This approach can be used to understand and identify prediabetes management practices in primary care, thereby informing interventions to improve guideline-concordant care.Keywords
All Related Versions
This publication has 42 references indexed in Scilit:
- Novel Use and Utility of Integrated Electronic Health Records to Assess Rates of Prediabetes Recognition and Treatment: Brief Report From an Integrated Electronic Health Records Pilot StudyDiabetes Care, 2014
- Screening for Prediabetes Using Machine Learning ModelsComputational and Mathematical Methods in Medicine, 2014
- Computational Intelligence-Based Diagnosis Tool for the Detection of Prediabetes and Type 2 Diabetes in IndiaThe Review of Diabetic Studies, 2012
- Prevalence, Diagnosis, and Treatment of Impaired Fasting Glucose and Impaired Glucose Tolerance in Nondiabetic U.S. AdultsDiabetes Care, 2010
- 10-year follow-up of diabetes incidence and weight loss in the Diabetes Prevention Program Outcomes StudyThe Lancet, 2009
- Many Americans Have Pre-Diabetes and Should Be Considered for Metformin TherapyDiabetes Care, 2009
- L1-Regularization Path Algorithm for Generalized Linear ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2007
- Reduction in the Incidence of Type 2 Diabetes with Lifestyle Intervention or MetforminNew England Journal of Medicine, 2002
- Support-vector networksMachine Learning, 1995
- A survey of decision tree classifier methodologyIEEE Transactions on Systems, Man, and Cybernetics, 1991