Handling onset age inconsistencies in longitudinal healthcare survey data
Preprint
Abstract
A bstract: Longitudinal healthcare surveys frequently contain inconsistencies in self-reported onset ages, where participants report different ages for the same condition between enrollment and follow-up surveys. We propose two methods to handle this challenge. First, we introduce a procedure that aggregates inconsistency patterns to construct participant-level reliability scores, enabling researchers to stratify participants and prioritize analysis on high-reliability cohorts. Second, we present a Bayesian adjustment method that models enrollment and follow-up reports as noisy observations of a latent true onset age, producing adjusted estimates for the inconsistent observations that account for age-dependent and inter-survey-time effects. We evaluate both methods using data from the Canadian Partnership for Tomorrow’s Health. In general, both methods substantially strengthen correlations between biologically related conditions and improve predictive performance across classification and regression tasks. In addition, high-reliability cohorts from reliability score-based stratification reveal more coherent and interpretable disease clustering networks, and Bayesian adjustment shows particularly notable gains when multiple inconsistent variables are adjusted simultaneously. Finally, we provide guidance on choosing between these methods for healthcare practitioners. Institutional Review Board (IRB): The study is approved by the University of British Columbia IRB (IRB #H23-03800). Data and Code Availability: CanPath data are available to researchers through a controlled access process via the CanPath Access Portal ( https://portal.canpath.ca ). The code is available at https://anonymous.4open.science/r/canpath-FCCF .Keywords
This publication has 46 references indexed in Scilit:
- Provincial Variation in Adherence to Breast Cancer Screening in Canada: Evidence From the Canadian Partnership for Tomorrow's HealthCancer Medicine, 2025
- Cohort Studies and Context: Infrastructure to Support Cancer Prevention2024
- Vestibular and cochlear dysfunction in aging: Two sides of the same coin?World Journal of Otorhinolaryngology - Head and Neck Surgery, 2022
- Lifestyle factors and lung cancer risk among never smokers in the Canadian Partnership for Tomorrow’s Health (CanPath)Cancer Causes & Control, 2022
- Improving reports of health risks: Life history calendars and measurement of potentially traumatic experiencesInternational Journal of Methods in Psychiatric Research, 2020
- Principal component analysisWIREs Computational Statistics, 2010
- Association Between Blood Pressure Level and the Risk of Myocardial Infarction, Stroke, and Total MortalityArchives of internal medicine (1960), 2001
- THE LIFE HISTORY CALENDAR: A RESEARCH AND CLINICAL ASSESSMENT METHOD FOR COLLECTING RETROSPECTIVE EVENT‐HISTORY DATAInternational Journal of Methods in Psychiatric Research, 1996
- Self-reported health and survival in the longitudinal study of aging, 1984–1986Journal of Clinical Epidemiology, 1995
- Reliability of self-reported age at onset of major depressionJournal of Psychiatric Research, 1989