Difference-based meta-analytic procedures for between-participant and/or within-participant designs: A tutorial review for sports and exercise scientists
- 4 February 2009
- journal article
- research article
- Published by Taylor & Francis in Journal of Sports Sciences
- Vol. 27 (3) , 237-255
Abstract
The aim of this paper is to provide a contemporary summary of statistical and non-statistical meta-analytic procedures that have relevance to the type of experimental designs often used by sport scientists when examining differences/change in dependent measure(s) as a result of one or more independent manipulation(s). Using worked examples from studies on observational learning in the motor behaviour literature, we adopt a random effects model and give a detailed explanation of the statistical procedures for the three types of raw score difference-based analyses applicable to between-participant, within-participant, and mixed-participant designs. Major merits and concerns associated with these quantitative procedures are identified and agreed methods are reported for minimizing biased outcomes, such as those for dealing with multiple dependent measures from single studies, design variation across studies, different metrics (i.e. raw scores and difference scores), and variations in sample size. To complement the worked examples, we summarize the general considerations required when conducting and reporting a meta-analysis, including how to deal with publication bias, what information to present regarding the primary studies, and approaches for dealing with outliers. By bringing together these statistical and non-statistical meta-analytic procedures, we provide the tools required to clarify understanding of key concepts and principles.Keywords
This publication has 38 references indexed in Scilit:
- Twenty-five years of psychology in theJournal of Sports Sciences: A historical overviewJournal of Sports Sciences, 2008
- Effects of Different Modes of Exercise Training on Glucose Control and Risk Factors for Complications in Type 2 Diabetic PatientsDiabetes Care, 2006
- Learning from demonstrations: the role of visual search during observational learning from video and point-light modelsJournal of Sports Sciences, 2002
- The Reporting and Analysis of Research Findings for Within–Subject Designs: Methodological Issues for Meta–AnalysisResearch Quarterly for Exercise and Sport, 1994
- What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.American Psychologist, 1992
- Observational Learning of Ballet Sequences: The Role of Kinematic InformationEcological Psychology, 1991
- The Effect of the Availability of a Dynamic Model on the Acquisition of a Complex Cyclical ActionThe Quarterly Journal of Experimental Psychology Section A, 1987
- The Use of Meta-Analysis in Exercise and Sport: A TutorialResearch Quarterly for Exercise and Sport, 1986
- A random effects model for effect sizes.Psychological Bulletin, 1983
- The file drawer problem and tolerance for null results.Psychological Bulletin, 1979