Uncovering survivorship bias in longitudinal mental health surveys during the COVID-19 pandemic
Open Access
- 26 May 2021
- journal article
- research article
- Published by Cambridge University Press (CUP) in Epidemiology and Psychiatric Sciences
- Vol. 30, 1-26
Abstract
Aims: Markedly elevated adverse mental health symptoms were widely observed early in the coronavirus disease-2019 (COVID-19) pandemic. Unlike the U.S., where cross-sectional data indicate anxiety and depression symptoms have remained elevated, such symptoms reportedly declined in the U.K., according to analysis of repeated measures from a large-scale longitudinal study. However, nearly 40% of U.K. respondents (those who did not complete multiple follow-up surveys) were excluded from analysis, suggesting that survivorship bias might partially explain this discrepancy. We therefore sought to assess survivorship bias among participants in our longitudinal survey study as part of The COVID-19 Outbreak Public Evaluation (COPE) Initiative. Methods: Survivorship bias was assessed in 4039 U.S. respondents who completed surveys including the assessment of mental health as part of The COPE Initiative in April 2020 and were invited to complete follow-up surveys. Participants completed validated screening instruments for symptoms of anxiety, depression and insomnia. Survivorship bias was assessed for (1) demographic differences in follow-up survey participation, (2) differences in initial adverse mental health symptom prevalence adjusted for demographic factors and (3) differences in follow-up survey participation based on mental health experiences adjusted for demographic factors. Results: Adjusting for demographics, individuals who completed only one or two out of four surveys had significantly higher prevalence of anxiety and depression symptoms in April 2020 (e.g. one-survey v. four-survey, anxiety symptoms, adjusted prevalence ratio [aPR]: 1.30, 95% confidence interval [CI]: 1.08–1.55, p = 0.0045; depression symptoms, aPR: 1.43, 95% CI: 1.17–1.75, p = 0.00052). Moreover, individuals who experienced incident anxiety or depression symptoms had significantly higher adjusted odds of not completing follow-up surveys (adjusted odds ratio [aOR]: 1.68, 95% CI: 1.22–2.31, p = 0.0015, aOR: 1.56, 95% CI: 1.15–2.12, p = 0.0046, respectively). Conclusions: Our findings reveal significant survivorship bias among longitudinal survey respondents, indicating that restricting analytic samples to only respondents who provide repeated assessments in longitudinal survey studies could lead to overly optimistic interpretations of mental health trends over time. Cross-sectional or planned missing data designs may provide more accurate estimates of population-level adverse mental health symptom prevalence than longitudinal surveys.Keywords
All Related Versions
This publication has 49 references indexed in Scilit:
- Cross sectional studies: advantages and disadvantagesBMJ, 2014
- The Sleep Condition Indicator: a clinical screening tool to evaluate insomnia disorderBMJ Open, 2014
- Sociodemographic and psychiatric predictors of attrition in a prospective psychiatric epidemiological study among the general population. Result of the Netherlands Mental Health Survey and Incidence Study-2Comprehensive Psychiatry, 2013
- Sociodemographic and psychiatric determinants of attrition in the Netherlands Study of Depression and Anxiety (NESDA)Comprehensive Psychiatry, 2012
- Weight Trimming and Propensity Score WeightingPLOS ONE, 2011
- A 4-item measure of depression and anxiety: Validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general populationJournal of Affective Disorders, 2010
- Association between self‐efficacy and loss to follow‐up in long‐term periodontal treatmentJournal of Clinical Periodontology, 2010
- Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliographyInternational Journal of Epidemiology, 2007
- Predictors of Loss to Follow-Up in Young Patients With Minor Trauma After Screening and Written Intervention for Alcohol in an Urban Emergency DepartmentJournal of Studies on Alcohol and Drugs, 2007
- Measuring depression outcome with a brief self-report instrument: sensitivity to change of the Patient Health Questionnaire (PHQ-9)Journal of Affective Disorders, 2004