Effectiveness of the researcher-led “Peerspectives” peer review training course on review quality, knowledge, and skills among doctoral students in the biomedical sciences: a pre-post study
Authors:
- Jessica L. RohmannJRJessica L. Rohmann
- Nadja WülkNWNadja Wülk
- Kerstin RubarthKRKerstin Rubarth
- Hannah GrillmaierHGHannah Grillmaier
- Iman AbdikarimIAIman Abdikarim
- Mariana Lopes SimõesMSMariana Lopes Simões
- Sara SchroterSSSara Schroter
- Marco PiccininniMPMarco Piccininni
- Tobias KurthTKTobias Kurth
- Toivo GlatzTGToivo Glatz
Open Access
- 29 May 2026
- journal article
- research article
- Published by Springer Nature in Research Integrity and Peer Review
- Vol. 11 (1) , 35
Abstract
Background: Peer review remains a cornerstone of scientific knowledge dissemination, yet comprehensive, practically relevant training is limited. This inspired us to develop Peerspectives , a peer review training course for doctoral students in the biomedical sciences in Berlin, Germany. We aimed to assess the effectiveness of the Peerspectives course on editor-judged quality of peer review reports. Methods: Doctoral students in health research fields who enrolled in the Peerspectives course between October 2020 and August 2022 were invited to participate in the study, and 80 consented. The ~18 week-long course provided training on the structure, purpose, and conduct of peer review and editorial processes in biomedical journals. It included 12 h of lectures, homework assignments, and 12 h of hands-on, small-group workshops, during which students reviewed original research manuscripts currently under consideration at The BMJ under the guidance of experienced mentors. The primary outcome was the overall quality of the peer review reports as judged by two independent BMJ editors using the global score of the Review Quality Instrument (RQI) pre- and post-intervention. Additionally, we compared participants’ post-course scores with those of actual BMJ reviewers. We also compared participants’ self-assessed knowledge and skills related to scholarly peer review (1–5 Likert scale) before and after the course. Results: After course completion, the editor-assessed overall quality of the participants’ peer review reports was higher than before the course (median increase of 0.5 points, p < 0.001; mean increase of 0.36 points, p < 0.001). The RQI scores of participants’ post-course reports were not non-inferior to those of actual BMJ reviewers for the same manuscripts. Self-assessed peer review-related knowledge skills increased across all questionnaire items after course completion. Greatest improvements were seen in understanding reviewer expectations (increase in means from 2.9 to 4.5), confidence in reviewing (2.5 to 3.9), and knowing what to look for while reviewing (2.8 to 4.2). Conclusions: Providing doctoral students with comprehensive training resulted in an editorially significant increase in review report quality and improved understanding of the role and expectations of peer reviewers in the scholarly publishing processes and confidence in giving constructive feedback. Pre-registration: https://osf.io/vndcxKeywords
Funding Information
- Wellcome Trust (218358)
- Volkswagen Foundation (9C872)
- Charité – Universitätsmedizin Berlin
This publication has 45 references indexed in Scilit:
- Reviewer training for improving grant and journal peer reviewCochrane Database of Systematic Reviews, 2023
- How to improve scientific peer review: Four schools of thoughtLearned Publishing, 2023
- Overburdening of peer reviewers: A multi‐stakeholder perspective on causes and effectsLearned Publishing, 2021
- The nonparametric Behrens–Fisher problem in partially complete clustered dataBiometrical Journal, 2020
- What does better peer review look like? Underlying principles and recommendations for better practiceLearned Publishing, 2019
- Rewarding reviewers – sense or sensibility? A Wiley study explainedLearned Publishing, 2016
- From Manuscript Evaluation to Article Valuation: The Changing Technologies of Journal Peer ReviewHuman Studies, 2014
- Bias in peer reviewJournal of the American Society for Information Science and Technology, 2012
- Peer review in a changing world: An international study measuring the attitudes of researchersJournal of the American Society for Information Science and Technology, 2012
- Effect of Written Feedback by Editors on Quality of ReviewsJAMA, 2002