Lessons Learned From a Sequential Mixed-Mode Survey Design to Recruit and Collect Data From Case-Control Study Participants: Formative Evaluation (Preprint)
Preprint
- 19 January 2024
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Sequential mixed-mode surveys using both web-based surveys and telephone interviews are increasingly being used in observational studies and have been shown to have many benefits; however, the application of this survey design has not been evaluated in the context of epidemiological case-control studies. OBJECTIVE In this paper, we discuss the challenges, benefits, and limitations of using a sequential mixed-mode survey design for a case-control study assessing risk factors during the COVID-19 pandemic. METHODS Colorado adults testing positive for SARS-CoV-2 were randomly selected and matched to those with a negative SARS-CoV-2 test result from March to April 2021. Participants were first contacted by SMS text message to complete a self-administered web-based survey asking about community exposures and behaviors. Those who did not respond were contacted for a telephone interview. We evaluated the representativeness of survey participants to sample populations and compared sociodemographic characteristics, participant responses, and time and resource requirements by survey mode using descriptive statistics and logistic regression models. RESULTS Of enrolled case and control participants, most were interviewed by telephone (308/537, 57.4% and 342/648, 52.8%, respectively), with overall enrollment more than doubling after interviewers called nonresponders. Participants identifying as female or White non-Hispanic, residing in urban areas, and not working outside the home were more likely to complete the web-based survey. Telephone participants were more likely than web-based participants to be aged 18-39 years or 60 years and older and reside in areas with lower levels of education, more linguistic isolation, lower income, and more people of color. While there were statistically significant sociodemographic differences noted between web-based and telephone case and control participants and their respective sample pools, participants were more similar to sample pools when web-based and telephone responses were combined. Web-based participants were less likely to report close contact with an individual with COVID-19 (odds ratio [OR] 0.70, 95% CI 0.53-0.94) but more likely to report community exposures, including visiting a grocery store or retail shop (OR 1.55, 95% CI 1.13-2.12), restaurant or cafe or coffee shop (OR 1.52, 95% CI 1.20-1.92), attending a gathering (OR 1.69, 95% CI 1.34-2.15), or sport or sporting event (OR 1.05, 95% CI 1.05-1.88). The web-based survey required an average of 0.03 (SD 0) person-hours per enrolled participant and US $920 in resources, whereas the telephone interview required an average of 5.11 person-hours per enrolled participant and US $70,000 in interviewer wages. CONCLUSIONS While we still encountered control recruitment challenges noted in other observational studies, the sequential mixed-mode design was an efficient method for recruiting a more representative group of participants for a case-control study with limited impact on data quality and should be considered during public health emergencies when timely and accurate exposure information is needed to inform control measures.Keywords
All Related Versions
- Published version: JMIR Formative Research, 8 (1), e56218.
This publication has 21 references indexed in Scilit:
- Prevention of Coronavirus Disease 2019 (COVID-19) by mRNA-Based Vaccines Within the General Population of CaliforniaClinical Infectious Diseases, 2021
- Online population control surveys: A new method for investigating foodborne outbreaksEpidemiology and Infection, 2020
- Web survey-based selection of controls for epidemiological analyses of a multi-prefectural outbreak of enterohaemorrhagicEscherichia coliO157 in Japan associated with consumption of self-grilled beef hanging tenderEpidemiology and Infection, 2018
- Online market research panel members as controls in case–control studies to investigate gastrointestinal disease outbreaks: early experiences and lessons learnt from the UKEpidemiology and Infection, 2018
- Comparing online and telephone survey results in the context of a skin cancer prevention campaign evaluationJournal of Public Health, 2016
- Control selection methods in recent case–control studies conducted as part of infectious disease outbreaksEuropean Journal of Epidemiology, 2015
- Factors affecting response rates of the web survey: A systematic reviewComputers in Human Behavior, 2010
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- Mode of questionnaire administration can have serious effects on data qualityJournal of Public Health, 2005
- Case-control studies: research in reverseThe Lancet, 2002