Reproducible research in statistics: A review and guidelines for the Biometrical Journal
- 29 December 2015
- journal article
- review article
- Published by Wiley in Biometrical Journal
- Vol. 58 (2) , 416-427
Abstract
Reproducible research (RR) constitutes the idea that a publication should be accompanied by all relevant material to reproduce the results and findings of a scientific work. Hence, results can be verified and researchers are able to build upon these. Efforts of the Biometrical Journal over the last five years have increased the number of manuscripts which are reproducible by a factor of 4 to almost 50%. Yet, more than half of the code submission could not be executed in the initial review due to missing code, missing data or errors in the code. Careful checks of the submitted code as part of the reviewing process are essential to eliminate these issues and to foster RR. In this article, we reviewed recent submissions of code and data to identify common reproducibility issues. Based on these findings, guidelines for structuring code submission to the Biometrical Journal have been established to help authors. These guidelines should help researchers to implement RR in general. Together with the code reviews, this supports the mission of the Biometrical Journal in publishing highest quality, novel and relevant papers on statistical methods and their applications in life sciences. Source code and data to reproduce the presented data analyses are available as Supplementary Material on the journal's web page.Keywords
This publication has 16 references indexed in Scilit:
- The Reproducibility Crisis in Science: A Statistical CounterattackSignificance, 2015
- Making Research Data Repositories Visible: The re3data.org RegistryPLOS ONE, 2013
- Case studies in reproducibilityBriefings in Bioinformatics, 2011
- Reproducible research and the substantive contextBiostatistics, 2010
- A re-evaluation of the statistical model in Pollet and Nettle 2009Evolution and Human Behavior, 2010
- Deriving chemosensitivity from cell lines: Forensic bioinformatics and reproducible research in high-throughput biologyThe Annals of Applied Statistics, 2009
- Biometrical Journal and Reproducible ResearchBiometrical Journal, 2009
- Reproducible research and BiostatisticsBiostatistics, 2009
- Reproducible Research in Computational Harmonic AnalysisComputing in Science & Engineering, 2008
- Literate ProgrammingThe Computer Journal, 1984