Incorporating data from multiple endpoints in the analysis of clinical trials: example from RSV vaccines
Authors:
Preprint
Abstract
Background: To achieve licensure, interventions typically must demonstrate efficacy against a primary outcome in a randomized clinical trial. However, selecting a single primary outcome a priori is challenging. Incorporating data from multiple and related outcomes might help to increase statistical power in clinical trials. Inspired by real-world clinical trials of interventions against respiratory syncytial virus (RSV), we examined methods for analyzing data on multiple endpoints. Method: We simulated data from three different populations in which the efficacy of the intervention and the correlation among outcomes varied. We developed a novel permutation-based approach that represents a weighted average of individual outcome test statistics ( varP ) to evaluate intervention efficacy in a multiple endpoint analysis. We compared the power and type I error rate of this approach to two alternative methods: the Bonferroni correction ( bonfT ) and another permutation-based approach that uses the minimum P-value across all test statistics ( minP ). Results: When the vaccine efficacy against different outcomes was similar, VarP yielded higher power than bonfT and minP; in some scenarios the improvement in power was substantial. In settings where vaccine efficacy was notably larger against one endpoint compared to the others, all three methods had similar power. Conclusions: Analyzing multiple endpoints using a weighted permutation method can increase power while controlling the type I error rate in settings where outcomes share similar characteristics, like RSV outcomes. We developed an R package, PERMEATE , to guide selection of the most appropriate method for analyzing multiple endpoints in clinical trials.Keywords
All Related Versions
- Published version: Epidemiology, 35 (1), 103.
This publication has 17 references indexed in Scilit:
- Bonferroni-Holm and permutation tests to compare health data: methodological and applicative issuesBMC Medical Research Methodology, 2018
- Optimal exact tests for multiple binary endpointsComputational Statistics & Data Analysis, 2018
- Respiratory syncytial virus prevention and asthma in healthy preterm infants: a randomised controlled trialThe Lancet Respiratory Medicine, 2018
- The costs and effectiveness of large Phase III pre-licensure vaccine clinical trialsExpert Review of Vaccines, 2015
- Traditional multiplicity adjustment methods in clinical trialsStatistics in Medicine, 2013
- Respiratory Syncytial Virus and Recurrent Wheeze in Healthy Preterm InfantsNew England Journal of Medicine, 2013
- Correlated bivariate continuous and binary outcomes: Issues and applicationsStatistics in Medicine, 2009
- A multiple testing correction method for genetic association studies using correlated single nucleotide polymorphismsGenetic Epidemiology, 2008
- How to deal with multiple endpoints in clinical trialsFundamental & Clinical Pharmacology, 2006
- Adjusting for multiple testing when reporting research results: the Bonferroni vs Holm methods.American Journal of Public Health, 1996