Sample size determination for mediation analysis of longitudinal data
Open Access
- 27 March 2018
- journal article
- research article
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 18 (1) , 1-11
Abstract
Sample size planning for longitudinal data is crucial when designing mediation studies because sufficient statistical power is not only required in grant applications and peer-reviewed publications, but is essential to reliable research results. However, sample size determination is not straightforward for mediation analysis of longitudinal design. To facilitate planning the sample size for longitudinal mediation studies with a multilevel mediation model, this article provides the sample size required to achieve 80% power by simulations under various sizes of the mediation effect, within-subject correlations and numbers of repeated measures. The sample size calculation is based on three commonly used mediation tests: Sobel’s method, distribution of product method and the bootstrap method. Among the three methods of testing the mediation effects, Sobel’s method required the largest sample size to achieve 80% power. Bootstrapping and the distribution of the product method performed similarly and were more powerful than Sobel’s method, as reflected by the relatively smaller sample sizes. For all three methods, the sample size required to achieve 80% power depended on the value of the ICC (i.e., within-subject correlation). A larger value of ICC typically required a larger sample size to achieve 80% power. Simulation results also illustrated the advantage of the longitudinal study design. The sample size tables for most encountered scenarios in practice have also been published for convenient use. Extensive simulations study showed that the distribution of the product method and bootstrapping method have superior performance to the Sobel’s method, but the product method was recommended to use in practice in terms of less computation time load compared to the bootstrapping method. A R package has been developed for the product method of sample size determination in mediation longitudinal study design.Keywords
This publication has 38 references indexed in Scilit:
- Sample Size Planning for Statistical Power and Accuracy in Parameter EstimationAnnual Review of Psychology, 2008
- Required Sample Size to Detect the Mediated EffectPsychological Science, 2007
- Therapist effects in psychotherapy: A random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program dataPsychotherapy Research, 2006
- Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care.Journal of Consulting and Clinical Psychology, 2005
- Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling MethodsMultivariate Behavioral Research, 2004
- Waiting for supershrink: an empirical analysis of therapist effectsClinical Psychology & Psychotherapy, 2003
- Multilevel Modeling of Individual and Group Level Mediated EffectsMultivariate Behavioral Research, 2001
- Direct and Indirect Effects in Linear Structural Equation ModelsSociological Methods & Research, 1987
- The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Journal of Personality and Social Psychology, 1986
- Statistical Power with Group Mean as the Unit of AnalysisJournal of Educational Statistics, 1981