Mastering a simulation-based parametric method to obtain bias-corrected point estimates and sampling variance for effect sizes
Open Access
- 28 September 2026
- journal article
- tutorial
- Published by Cambridge University Press (CUP) in Research Synthesis Methods
- p. 1-28
Abstract
Meta-analyses require an effect-size estimate and its corresponding sampling variance from primary studies. For some effect size statistics, however, estimators of sampling variance are unavailable, requiring new derivations. Traditionally, such formulas are obtained using hand-derived Taylor expansions (the delta method), but this approach can be technically demanding and inaccessible to many applied researchers. Building on the idea of single-fit parametric resampling, we introduce the SAFE bootstrap: a Single-fit, Accurate, Fast, and Easy simulation recipe that replaces complex algebra with four intuitive steps: fit, draw, transform, and summarise. SAFE is a model-based parametric bootstrap applied to summary statistics, so its performance depends on how well the assumed sampling model approximates the sampling distribution of the reported statistics. Here, we focus on two-group effect sizes that can be parameterised from standard reported summaries, using Gaussian working models for continuous outcomes and binomial or multinomial models for discrete outcomes. Within this framework, SAFE yields model-based, bias-corrected point estimates and standard errors for familiar effect sizes, and readily extends to less common statistics. We first demonstrate SAFE with a simple example, then apply it to common effect sizes, such as the standardised mean difference and the log odds ratio, as well as several less common measures. With additional coding, SAFE can also accommodate zero values and small sample sizes, albeit with important caveats. Our tutorial, accompanied by R code supplements, aims both to clarify the logic of simulation-based estimation from summary statistics and to provide a practical workflow when only summary statistics are available.Keywords
All Related Versions
Funding Information
- Australian Research Council (DP230101248,FT220100276,FT230100240)
- Canada Excellence Research Chairs, Government of Canada (CERC-2022-00074)
This publication has 30 references indexed in Scilit:
- Meta-analysis reveals that phenotypic plasticity and divergent selection promote reproductive isolation during incipient speciationNature Ecology & Evolution, 2025
- Cluster wild bootstrapping to handle dependent effect sizes in meta‐analysis with a small number of studiesResearch Synthesis Methods, 2022
- Introduction to Meta‐Analysis2021
- Revisiting and expanding the meta‐analysis of variation: The log coefficient of variation ratioResearch Synthesis Methods, 2020
- Plastic responses to novel environments are biased towards phenotype dimensions with high additive genetic variationProceedings of the National Academy of Sciences, 2019
- A Confidence‐Limit‐Based Approach to the Assessment of Hardy–Weinberg EquilibriumBiometrical Journal, 2010
- Meta‐analysis of skewed data: Combining results reported on log‐transformed or raw scalesStatistics in Medicine, 2008
- Categorical Data Analysis2002
- A meta-analysis of elevated CO 2 effects on woody plant mass, form, and physiologyOecologia, 1998
- Estimation of effect size from a series of independent experiments.Psychological Bulletin, 1982