Moving Sport and Exercise Science Forward: A Call for the Adoption of More Transparent Research Practices
Authors:
- Consortium for Transparency in Exercise Science (COTES) CollaboratorsCCConsortium for Transparency in Exercise Science (COTES) Collaborators
- Aaron R. CaldwellACAaron R. Caldwell
- Andrew D. VigotskyAVAndrew D. Vigotsky
- Andreas KreutzerAKAndreas Kreutzer
- John P. MillsJMJohn P. Mills
- Matthieu P. BoisgontierMBMatthieu P. Boisgontier
- 4 February 2020
- journal article
- research article
- Published by Springer Nature in Sports Medicine
- Vol. 50 (3) , 449-459
Abstract
The primary means of disseminating sport and exercise science research is currently through journal articles. However, not all studies, especially those with null findings, make it to formal publication. This publication bias towards positive findings may contribute to questionable research practices. Preregistration is a solution to prevent the publication of distorted evidence resulting from this system. This process asks authors to register their hypotheses and methods before data collection on a publicly available repository or by submitting a Registered Report. In the Registered Report format, authors submit a stage 1 manuscript to a participating journal that includes an introduction, methods, and any pilot data indicating the exploratory or confirmatory nature of the study. After a stage 1 peer review, the manuscript can then be offered in-principle acceptance, rejected, or sent back for revisions to improve the quality of the study. If accepted, the project is guaranteed publication, assuming the authors follow the data collection and analysis protocol. After data collection, authors re-submit a stage 2 manuscript that includes the results and discussion, and the study is evaluated on clarity and conformity with the planned analysis. In its final form, Registered Reports appear almost identical to a typical publication, but give readers confidence that the hypotheses and main analyses are less susceptible to bias from questionable research practices. From this perspective, we argue that inclusion of Registered Reports by researchers and journals will improve the transparency, replicability, and trust in sport and exercise science research. The preprint version of this work is available on SportR\(\chi \)iv: https://osf.io/preprints/sportrxiv/fxe7a/ .
Keywords
All Related Versions
This publication has 62 references indexed in Scilit:
- Publication of Sports Medicine–Related Randomized Controlled Trials Registered in ClinicalTrials.govThe American Journal of Sports Medicine, 2012
- Measuring the Prevalence of Questionable Research Practices With Incentives for Truth TellingPsychological Science, 2012
- On the Plurality of (Methodological) Worlds: Estimating the Analytic Flexibility of fMRI ExperimentsFrontiers in Neuroscience, 2012
- Wishful ThinkingPsychological Science, 2011
- How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey DataPLOS ONE, 2009
- Why Most Discovered True Associations Are InflatedEpidemiology, 2008
- Protocol for the PACE trial: A randomised controlled trial of adaptive pacing, cognitive behaviour therapy, and graded exercise as supplements to standardised specialist medical care versus standardised specialist medical care alone for patients with the chronic fatigue syndrome/myalgic encephalomyelitis or encephalopathyBMC Neurology, 2007
- Testing multiple statistical hypotheses resulted in spurious associations: a study of astrological signs and healthJournal of Clinical Epidemiology, 2006
- Why Most Published Research Findings Are FalsePLOS Medicine, 2005
- Hindsight != foresight: the effect of outcome knowledge on judgment under uncertaintyQuality and Safety in Health Care, 2003