Abstract
Estimating treatment effects from observational data requires careful specification of the study timeline. Investigators must determine when eligibility is assessed, when treatment is assigned, and when follow-up begins. Seemingly minor choices at this stage can introduce subtle time-related biases and compromise valid inference. We show how this is relevant to a recent article suggesting that SARS-CoV-2 mRNA (COVID-19) vaccines increase the effectiveness of immune checkpoint inhibitors in cancer patients (Grippin et al.). We first describe the original study timeline and find several sources of bias arising from its specifications. These time-related biases lead to erroneous conclusions about protective treatment effects. We then explain how time-related biases can be mitigated by careful target trial emulation, and we specify and emulate a target trial for the study of Grippin et al. In this target trial emulation, the estimated 3-year overall survival was 45.7% in the vaccinated group and 43.8% in the unvaccinated group (difference, 1.9 percentage points [95% CI, −23.6 to 25.0]), substantially attenuating the benefit of COVID-19 vaccines found in the original analysis.

This publication has 10 references indexed in Scilit: