Promoting Replicability in Developmental Research Through Meta-analyses: Insights From Language Acquisition Research
Top Cited Papers
Open Access
- 1 November 2018
- journal article
- research article
- Published by Oxford University Press (OUP) in Child Development
- Vol. 89 (6) , 1996-2009
Abstract
Previous work suggests that key factors for replicability, a necessary feature for theory building, include statistical power and appropriate research planning. These factors are examined by analyzing a collection of 12 standardized meta‐analyses on language development between birth and 5 years. With a median effect size of Cohen's d = .45 and typical sample size of 18 participants, most research is underpowered (range = 6%–99%; median = 44%); and calculating power based on seminal publications is not a suitable strategy. Method choice can be improved, as shown in analyses on exclusion rates and effect size as a function of method. The article ends with a discussion on how to increase replicability in both language acquisition studies specifically and developmental research more generally.Keywords
All Related Versions
Funding Information
- Berkeley Initiative for Transparency in the Social Sciences, a program of the Center for Effective Global Action
- Laura and John Arnold Foundation
- H2020 European Research Council (660911)
- H2020 European Research Council (659553)
- Agence Nationale de la Recherche (ANR-14-CE30-0003)
- Agence Nationale de la Recherche (ANR-10-IDEX-0001-02)
- Agence Nationale de la Recherche (ANR-10-LABX-0087)
- Fondation de France
- Laura and John Arnold Foundation
- H2020 European Research Council (660911)
- H2020 European Research Council (659553)
- Agence Nationale de la Recherche (ANR‐14‐CE30‐0003)
- Agence Nationale de la Recherche (ANR‐10‐IDEX‐0001‐02)
- Agence Nationale de la Recherche (ANR‐10‐LABX‐0087)
- Fondation de France
This publication has 30 references indexed in Scilit:
- False-Positive PsychologyPsychological Science, 2011
- Erroneous analyses of interactions in neuroscience: a problem of significanceNature Neuroscience, 2011
- Fixed effects and variance components estimation in three-level meta-analysisResearch Synthesis Methods, 2011
- The relation between pointing and language development: A meta-analysisDevelopmental Review, 2010
- Eye Tracking in Infancy ResearchDevelopmental Neuropsychology, 2009
- Big Correlations in Little Studies: Inflated fMRI Correlations Reflect Low Statistical Power—Commentary on Vul et al. (2009)Perspectives on Psychological Science, 2009
- Why Most Published Research Findings Are FalsePLOS Medicine, 2005
- Relationships fade with time: a meta-analysis of temporal trends in publication in ecology and evolutionProceedings Of The Royal Society B-Biological Sciences, 2002
- Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs.Psychological Methods, 2002
- Meta-analysis of experiments with matched groups or repeated measures designs.Psychological Methods, 1996