Publication Bias in Recent Meta-Analyses
Open Access
- 27 November 2013
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 8 (11) , e81823
Abstract
Positive results have a greater chance of being published and outcomes that are statistically significant have a greater chance of being fully reported. One consequence of research underreporting is that it may influence the sample of studies that is available for a meta-analysis. Smaller studies are often characterized by larger effects in published meta-analyses, which can be possibly explained by publication bias. We investigated the association between the statistical significance of the results and the probability of being included in recent meta-analyses. For meta-analyses of clinical trials, we defined the relative risk as the ratio of the probability of including statistically significant results favoring the treatment to the probability of including other results. For meta-analyses of other studies, we defined the relative risk as the ratio of the probability of including biologically plausible statistically significant results to the probability of including other results. We applied a Bayesian selection model for meta-analyses that included at least 30 studies and were published in four major general medical journals (BMJ, JAMA, Lancet, and PLOS Medicine) between 2008 and 2012. We identified 49 meta-analyses. The estimate of the relative risk was greater than one in 42 meta-analyses, greater than two in 16 meta-analyses, greater than three in eight meta-analyses, and greater than five in four meta-analyses. In 10 out of 28 meta-analyses of clinical trials, there was strong evidence that statistically significant results favoring the treatment were more likely to be included. In 4 out of 19 meta-analyses of observational studies, there was strong evidence that plausible statistically significant outcomes had a higher probability of being included. Publication bias was present in a substantial proportion of large meta-analyses that were recently published in four major medical journals.Keywords
This publication has 54 references indexed in Scilit:
- Association of alcohol consumption with selected cardiovascular disease outcomes: a systematic review and meta-analysisBMJ, 2011
- Extent of publication bias in different categories of research cohorts: a meta-analysis of empirical studiesBMC Medical Research Methodology, 2009
- Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation studyBMC Medical Research Methodology, 2009
- Selective Publication of Antidepressant Trials and Its Influence on Apparent EfficacyNew England Journal of Medicine, 2008
- Performance of the trim and fill method in the presence of publication bias and between‐study heterogeneityStatistics in Medicine, 2007
- Arcsine test for publication bias in meta‐analyses with binary outcomesStatistics in Medicine, 2007
- The case of the misleading funnel plotBMJ, 2006
- Comparison of Two Methods to Detect Publication Bias in Meta-analysisJAMA, 2006
- A modified test for small‐study effects in meta‐analyses of controlled trials with binary endpointsStatistics in Medicine, 2005
- Adjusting for publication bias in the presence of heterogeneityStatistics in Medicine, 2003