Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
Top Cited Papers
Open Access
- 1 December 2020
- journal article
- research article
- Published by Springer Nature in Research Integrity and Peer Review
- Vol. 5 (1) , 1-19
Abstract
Background: Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to published articles. An objective dimension of quality that is readily measurable is completeness of reporting, as transparency can improve the reader’s ability to independently interpret data and reproduce findings. Methods: In this observational study, we initially compared independent samples of articles published in bioRxiv and in PubMed-indexed journals in 2016 using a quality of reporting questionnaire. After that, we performed paired comparisons between preprints from bioRxiv to their own peer-reviewed versions in journals. Results: Peer-reviewed articles had, on average, higher quality of reporting than preprints, although the difference was small, with absolute differences of 5.0% [95% CI 1.4, 8.6] and 4.7% [95% CI 2.4, 7.0] of reported items in the independent samples and paired sample comparison, respectively. There were larger differences favoring peer-reviewed articles in subjective ratings of how clearly titles and abstracts presented the main findings and how easy it was to locate relevant reporting information. Changes in reporting from preprints to peer-reviewed versions did not correlate with the impact factor of the publication venue or with the time lag from bioRxiv to journal publication. Conclusions: Our results suggest that, on average, publication in a peer-reviewed journal is associated with improvement in quality of reporting. They also show that quality of reporting in preprints in the life sciences is within a similar range as that of peer-reviewed articles, albeit slightly lower on average, supporting the idea that preprints should be considered valid scientific contributions.Keywords
All Related Versions
Funding Information
- Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro
- Conselho Nacional de Desenvolvimento Científico e Tecnológico
- Programa Institucional de Bolsas de Iniciação Científica - UFRJ
This publication has 41 references indexed in Scilit:
- Who's Afraid of Peer Review?2013
- Are Peer Reviewers Encouraged to Use Reporting Guidelines? A Survey of 116 Health Research JournalsPLOS ONE, 2012
- Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trialBMJ, 2011
- Improving Bioscience Research Reporting: The ARRIVE Guidelines for Reporting Animal ResearchPLOS Biology, 2010
- Who is afraid of reviewers’ comments? Or, why anything can be published and anything can be citedEuropean Journal of Clinical Investigation, 2010
- The EQUATOR Network and reporting guidelines: Helping to achieve high standards in reporting health research studiesMaturitas, 2009
- Editorial peer review for improving the quality of reports of biomedical studiesCochrane Database of Systematic Reviews, 2007
- Statistical Reviewers Improve Reporting in Biomedical Articles: A Randomized TrialPLOS ONE, 2007
- The CONSORT Statement: Revised Recommendations for Improving the Quality of Reports of Parallel-Group Randomized TrialsJAMA, 2001
- Publication prejudices: An experimental study of confirmatory bias in the peer review systemCognitive Therapy and Research, 1977