Something Out of Nothing? The Influence of Double-Zero Studies in Meta-analysis of Adverse Events in Clinical Trials
Open Access
- 1 May 2024
- journal article
- research article
- Published by Springer Nature in Statistics in Biosciences
- Vol. 18 (3) , 1-19
Abstract
In addition to clinical efficacy, safety is another important outcome to assess in randomized controlled trials. It focuses on the occurrence of adverse events, such as stroke, deaths, and other rare events. Because of the low or very low rates of observing adverse events, meta-analysis is often used to pooled together evidence from dozens or even hundreds of similar clinical trials to strengthen inference. A well-known issue in rare-event meta-analysis is that some or even majority of the available studies may observe zero events in both the treatment and control groups. The influence of these so-called double-zero studies has been researched in the literature, which nevertheless focuses on reaching a dichotomous conclusion—whether or not double-zero studies should be included in the analysis. It has not been addressed when and how they contribute to inference, especially for the odds ratio. This paper fills this gap using comparative analysis of real and simulated data sets. We find that a double-zero study contributes to the odds ratio inference through its sample sizes in the two arms. When a double-zero study has an unequal allocation of patients in its two arms, it may contain non-ignorable information. Exclusion of these studies, if taking a significant proportion of the study cohort, may result in inflated type I error, deteriorated testing power, and increased estimation bias.Keywords
This publication has 27 references indexed in Scilit:
- Meta‐Analysis of Rare Events2019
- Random‐effects meta‐analysis of few studies involving rare eventsResearch Synthesis Methods, 2019
- Real-world Performance of Meta-analysis Methods for Double-Zero-Event Studies with Dichotomous Outcomes Using the Cochrane Database of Systematic ReviewsJournal of General Internal Medicine, 2019
- Statistical methods for meta‐analyses including information from studies without any events—add nothing to nothing and succeed neverthelessStatistics in Medicine, 2014
- Off-pump versus on-pump coronary artery bypass grafting for ischaemic heart diseaseCochrane Database of Systematic Reviews, 2012
- Much ado about nothing: a comparison of the performance of meta‐analytical methods with rare eventsStatistics in Medicine, 2006
- What to add to nothing? Use and avoidance of continuity corrections in meta‐analysis of sparse dataStatistics in Medicine, 2004
- Bayesian random effects meta‐analysis of trials with binary outcomes: methods for the absolute risk difference and relative risk scalesStatistics in Medicine, 2002
- Cognitive Outcome After Off-Pump and On-Pump Coronary Artery Bypass Graft SurgeryA Randomized TrialJAMA, 2002
- Bayesian approaches to random‐effects meta‐analysis: A comparative studyStatistics in Medicine, 1995