Improving accuracy in the estimation of probable dementia in racially and ethnically diverse groups with penalized regression and transfer learning
Open Access
- 6 January 2025
- journal article
- Published by Oxford University Press (OUP) in American Journal of Epidemiology
- Vol. 195 (1) , 237-245
Abstract
Algorithmic estimations of dementia status are widely used in public health and epidemiologic research, but inadequate algorithm performance across racial/ethnic groups has been a barrier. We present improvements in the accuracy of group-specific “probable dementia” estimation using a transfer learning approach. Transfer learning involves combining models trained on a large “source” data set with imprecise outcome assessments, alongside models trained on a smaller “target” data set with high-quality outcome assessments. Transfer learning improves model accuracy by leveraging large-source data while refining estimations with smaller, target data. We illustrate with data from the Health and Retirement Study (source data: n = 6630) and the Harmonized Cognitive Assessment Protocol (target data: n = 2388). Models for dementia status estimation were evaluated through overall accuracy (Brier score), calibration (intercept, slope), and discriminative ability (area under the receiver operating characteristic curve [AUR] and area under the precision-recall curve [AUPRC]). The transfer-learned algorithm showed higher accuracy compared to the best previously reported algorithm among both non-Hispanic Black participants (Brier 0.049 vs 0.061; AUC 0.84 vs 0.81; AUPRC 0.52 vs 0.39) and Hispanic participants (Brier 0.052 vs 0.056; AUC 0.89 vs 0.87; AUPRC 0.61 vs 0.56). Transfer learning can improve dementia status estimation for groups historically underrepresented in research. This article is part of a Special Collection on Methods in Social Epidemiology.Keywords
Funding Information
- National Institute on Aging and the US Alzheimer’s Association
- National Institute on Aging (R01AG072681)
- European Research Council under the European Union’s Horizon 2020 research and innovation program (803239)
- Health and Retirement Study (U01AG009740)
- National Institute on Aging (NIAU01AG009740)
This publication has 29 references indexed in Scilit:
- Estimating the Prevalence of Dementia and Mild Cognitive Impairment in the USJAMA Neurology, 2022
- Trends in inequalities in the prevalence of dementia in the United StatesProceedings of the National Academy of Sciences, 2022
- Deep transfer learning for reducing health care disparities arising from biomedical data inequalityNature Communications, 2020
- Validation of clinical prediction models: what does the “calibration slope” really measure?Journal of Clinical Epidemiology, 2020
- Inequalities in dementia incidence between six racial and ethnic groups over 14 yearsAlzheimer's & Dementia, 2016
- Prediction models need appropriate internal, internal–external, and external validationJournal of Clinical Epidemiology, 2016
- Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD statementBritish Journal of Cancer, 2015
- Monetary Costs of Dementia in the United StatesNew England Journal of Medicine, 2013
- Use of Brier score to assess binary predictionsJournal of Clinical Epidemiology, 2010
- The Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE): socio-demographic correlates, reliability, validity and some normsPsychological Medicine, 1989