The dark side of the force: Multiplicity issues in network meta‐analysis and how to address them
Open Access
- 2 September 2019
- journal article
- research article
- Published by Wiley in Research Synthesis Methods
- Vol. 11 (1) , 105-122
Abstract
Standard models for network meta‐analysis simultaneously estimate multiple relative treatment effects. In practice, after estimation, these multiple estimates usually pass through a formal or informal selection procedure, eg, when researchers draw conclusions about the effects of the best performing treatment in the network. In this paper, we present theoretical arguments as well as results from simulations to illustrate how such practices might lead to exaggerated and overconfident statements regarding relative treatment effects. We discuss how the issue can be addressed via multilevel Bayesian modelling, where treatment effects are modelled exchangeably, and hence estimates are shrunk away from large values. We present a set of alternative models for network meta‐analysis, and we show in simulations that in several scenarios, such models perform better than the usual network meta‐analysis model.Keywords
Funding Information
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (180083)
This publication has 33 references indexed in Scilit:
- Efficacy of New Generation Antidepressants: Differences Seem IllusoryPLOS ONE, 2013
- Evidence Synthesis for Decision Making 2Medical Decision Making, 2012
- Network meta‐analysis models to account for variability in treatment definitions: application to dose effectsStatistics in Medicine, 2012
- Why We (Usually) Don't Have to Worry About Multiple ComparisonsJournal of Research on Educational Effectiveness, 2012
- A Review and Bayesian Meta-Analysis of Clinical Efficacy and Adverse Effects of 4 Atypical Neuroleptic Drugs Compared With Haloperidol and PlaceboJournal of Clinical Psychopharmacology, 2011
- Linear inference for mixed treatment comparison meta-analysis: A two-stage approachResearch Synthesis Methods, 2011
- Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorialJournal of Clinical Epidemiology, 2011
- The BUGS project: Evolution, critique and future directionsStatistics in Medicine, 2009
- A farewell to Bonferroni: the problems of low statistical power and publication biasBehavioral Ecology, 2004
- Combination of direct and indirect evidence in mixed treatment comparisonsStatistics in Medicine, 2004