Guidance for Increasing Primary Study Inclusion and the Usability of Data in Meta-Analysis: A Reporting Tutorial
- 20 June 2023
- journal article
- research article
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 66 (6) , 1899-1907
Abstract
Meta-analyses can be used to comprehensively summarize the state of a given literature base, understand development and relations between constructs, and synthesize intervention effects to identify "what works for whom," all of which can directly inform research, practice, and policy. In this tutorial, we first argue that data reporting in primary studies can meaningfully affect the results of meta-analyses and, most importantly, the subsequent interpretations and use of the findings in research, practice, and policy in speech, language, and hearing sciences. Though reporting guidelines have been well established for the results of meta-analyses, there is limited focus on the essentials for primary study reporting that allow for inclusion in meta-analyses. To this end, we provide guid-ance for primary study authors to ensure their studies can maximize their contri-butions to research syntheses and, specifically, to meta-analyses. We discuss current and ongoing issues related to reporting, provide data-based examples of instances where lack of reporting or transparency has rendered a study ineligible from inclusion in a meta-analysis, encourage editorial teams and peer reviewers to be flexible in the inclusion of supplemental data reporting based on journal requirements and limits, and suggest being explicit and earnest about why these requests are important to advancing the field.Keywords
This publication has 35 references indexed in Scilit:
- A manifesto for reproducible scienceNature Human Behaviour, 2017
- Associations Between Language and Problem Behavior: a Systematic Review and Correlational Meta-analysisEducational Psychology Review, 2016
- Intervention effects on spoken‐language outcomes for children with autism: a systematic review and meta‐analysisJournal of Intellectual Disability Research, 2016
- Estimating the Difference Between Published and Unpublished Effect SizesReview of Educational Research, 2016
- Relations Among Children's Use of Dialect and Literacy Skills: A Meta-AnalysisJournal of Speech, Language, and Hearing Research, 2015
- The Efficacy of Recasts in Language Intervention: A Systematic Review and Meta-AnalysisAmerican Journal of Speech-Language Pathology, 2015
- Outcome-Reporting Bias in Education ResearchEducational Researcher, 2013
- An introduction to methodological issues when including non‐randomised studies in systematic reviews on the effects of interventionsResearch Synthesis Methods, 2013
- Differential treatment intensity research: A missing link to creating optimally effective communication interventionsMental Retardation and Developmental Disabilities Research Reviews, 2007
- Publication Bias in Meta‐Analysis2005