High-dimensional multiple imputation for partially observed confounders including natural language processing–derived auxiliary covariates
- 8 January 2025
- journal article
- Published by Oxford University Press (OUP) in American Journal of Epidemiology
- Vol. 195 (1) , 10-20
Abstract
Multiple imputation (MI) models can be improved with auxiliary covariates (ACs), but their performance in high-dimensional data remains unclear. We aimed to develop and compare high-dimensional MI (HDMI) methods using structured and natural language processing (NLP)–derived AC in studies with partially observed confounders. We conducted a plasmode simulation with acute kidney injury as outcome and simulated 100 cohorts with a null treatment effect, incorporating creatinine labs, atrial fibrillation (AFib), and other investigator-derived confounders in the outcome generation. Missingness was imposed on creatinine based on creatinine itself and AFib. Different HDMI candidate ACs were created using structured and NLP-derived features, and we mimicked scenarios where AFib was unobserved by omitting it from all analyses. Using the least absolute shrinkage and selection operator, we selected HDMI covariates for MI and propensity score models. The treatment effect was estimated after propensity score matching in MI datasets, and HDMI methods were compared to baseline imputation and complete case analysis. High-dimensional MI using claims data showed the lowest bias (0.072). Combining claims and sentence embeddings led to an improvement in the efficiency with a root mean square error (RMSE) of 0.173 and 94% coverage. Natural language processing–derived AC alone did not outperform baseline MI. High-dimensional MI approaches may decrease bias in studies where confounder missingness depends on unobserved factors.Keywords
All Related Versions
Funding Information
- NIH (RO1LM013204)
- Master Agreement (75F40119D10037)
- Task Order (75F40119F19002)
This publication has 38 references indexed in Scilit:
- The FDA Sentinel Real World Evidence Data Enterprise (RWE‐DE)Pharmacoepidemiology and Drug Safety, 2024
- Statistical plasmode simulations–Potentials, challenges and recommendationsStatistics in Medicine, 2024
- A comparison of strategies for selecting auxiliary variables for multiple imputationBiometrical Journal, 2024
- Scalable Feature Engineering from Electronic Free Text Notes to Supplement Confounding Adjustment of Claims‐Based Pharmacoepidemiologic StudiesClinical Pharmacology & Therapeutics, 2023
- Longitudinal Data Discontinuity in Electronic Health Records and Consequences for Medication Effectiveness StudiesClinical Pharmacology & Therapeutics, 2021
- Prevalence of Missing Data in the National Cancer Database and Association With Overall SurvivalJAMA Network Open, 2021
- Using simulation studies to evaluate statistical methodsStatistics in Medicine, 2019
- Identifying Patients With High Data Completeness to Improve Validity of Comparative Effectiveness Research in Electronic Health Records DataClinical Pharmacology & Therapeutics, 2017
- The use of propensity score methods with survival or time‐to‐event outcomes: reporting measures of effect similar to those used in randomized experimentsStatistics in Medicine, 2013
- A systematic review of validated methods for identifying atrial fibrillation using administrative dataPharmacoepidemiology and Drug Safety, 2012