Selecting relevant moderators with Bayesian regularized meta‐regression
Open Access
- 1 March 2023
- journal article
- research article
- Published by Wiley in Research Synthesis Methods
- Vol. 14 (2) , 301-322
Abstract
When meta‐analyzing heterogeneous bodies of literature, meta‐regression can be used to account for potentially relevant between‐studies differences. A key challenge is that the number of candidate moderators is often high relative to the number of studies. This introduces risks of overfitting, spurious results, and model non‐convergence. To overcome these challenges, we introduce Bayesian Regularized Meta‐Analysis (BRMA), which selects relevant moderators from a larger set of candidates by shrinking small regression coefficients towards zero with regularizing (LASSO or horseshoe) priors. This method is suitable when there are many potential moderators, but it is not known beforehand which of them are relevant. A simulation study compared BRMA against state‐of‐the‐art random effects meta‐regression using restricted maximum likelihood (RMA). Results indicated that BRMA outperformed RMA on three metrics: BRMA had superior predictive performance, which means that the results generalized better; BRMA was better at rejecting irrelevant moderators, and worse at detecting true effects of relevant moderators, while the overall proportion of Type I and Type II errors was equivalent to RMA. BRMA regression coefficients were slightly biased towards zero (by design), but its residual heterogeneity estimates were less biased than those of RMA. BRMA performed well with as few as 20 studies, suggesting its suitability as a small sample solution. We present free open source software implementations in the R‐packagepema(for penalized meta‐analysis) and in the stand‐alone statistical program JASP. An applied example demonstrates the use of the R‐package.Keywords
All Related Versions
Funding Information
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (VI.Veni.191G.090)
This publication has 36 references indexed in Scilit:
- Avoiding zero between‐study variance estimates in random‐effects meta‐analysisStatistics in Medicine, 2013
- Unpublished results hide the decline effectNature, 2011
- Interpretation of random effects meta-analysesBMJ, 2011
- The Bayesian LassoJournal of the American Statistical Association, 2008
- How should meta‐regression analyses be undertaken and interpreted?Statistics in Medicine, 2002
- Quantifying heterogeneity in a meta‐analysisStatistics in Medicine, 2002
- Fixed- and random-effects models in meta-analysis.Psychological Methods, 1998
- Inference after variable selection in linear regression modelsBiometrika, 1992
- Inference from Iterative Simulation Using Multiple SequencesStatistical Science, 1992
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974