Detection of probable dementia cases in undiagnosed patients using structured and unstructured electronic health records
Open Access
- 9 July 2019
- journal article
- research article
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 19 (1) , 1-11
Abstract
Dementia is underdiagnosed in both the general population and among Veterans. This underdiagnosis decreases quality of life, reduces opportunities for interventions, and increases health-care costs. New approaches are therefore necessary to facilitate the timely detection of dementia. This study seeks to identify cases of undiagnosed dementia by developing and validating a weakly supervised machine-learning approach that incorporates the analysis of both structured and unstructured electronic health record (EHR) data. A topic modeling approach that included latent Dirichlet allocation, stable topic extraction, and random sampling was applied to VHA EHRs. Topic features from unstructured data and features from structured data were compared between Veterans with (n = 1861) and without (n = 9305) ICD-9 dementia codes. A logistic regression model was used to develop dementia prediction scores, and manual reviews were conducted to validate the machine-learning results. A total of 853 features were identified (290 topics, 174 non-dementia ICD codes, 159 CPT codes, 59 medications, and 171 note types) for the development of logistic regression prediction scores. These scores were validated in a subset of Veterans without ICD-9 dementia codes (n = 120) by experts in dementia who performed manual record reviews and achieved a high level of inter-rater agreement. The manual reviews were used to develop a receiver of characteristic (ROC) curve with different thresholds for case detection, including a threshold of 0.061, which produced an optimal sensitivity (0.825) and specificity (0.832). Dementia is underdiagnosed, and thus, ICD codes alone cannot serve as a gold standard for diagnosis. However, this study suggests that imperfect data (e.g., ICD codes in combination with other EHR features) can serve as a silver standard to develop a risk model, apply that model to patients without dementia codes, and then select a case-detection threshold. The study is one of the first to utilize both structured and unstructured EHRs to develop risk scores for the diagnosis of dementia.Keywords
Funding Information
- VA VISN-20 Geriatric Research, Education, and Clinical Center (Clinical Demonstration Project)
- National Institute on Aging (R56 AG059739)
This publication has 33 references indexed in Scilit:
- The Electronic Medical Records and Genomics (eMERGE) Network: past, present, and futureGenetics in Medicine, 2013
- Use of Administrative Data to Estimate the Incidence of Statin-Related RhabdomyolysisJAMA, 2012
- Natural language processing: an introductionJournal of the American Medical Informatics Association, 2011
- The eMERGE Network: A consortium of biorepositories linked to electronic medical records data for conducting genomic studiesBMC Medical Genomics, 2011
- Rapid appraisal of barriers to the diagnosis and management of patients with dementia in primary care: a systematic reviewBMC Family Practice, 2010
- Posttraumatic Stress Disorder and Risk of Dementia Among US VeteransArchives of General Psychiatry, 2010
- Missed and Delayed Diagnosis of Dementia in Primary CareAlzheimer Disease & Associated Disorders, 2009
- Acceptance of dementia screening in continuous care retirement communities: a mailed surveyInternational Journal of Geriatric Psychiatry, 2003
- Dementia in Elderly Persons in a General HospitalAmerican Journal of Psychiatry, 2000
- Adapting a clinical comorbidity index for use with ICD-9-CM administrative databasesJournal of Clinical Epidemiology, 1992