Impact of author characteristics on outcomes of single- versus double-blind peer review: a systematic review of comparative studies in scientific abstracts and publications
Open Access
- 16 December 2024
- journal article
- research article
- Published by Springer Nature in Scientometrics
- Vol. 130 (1) , 399-421
Abstract
The purpose of this systematic review was to assess the role of double-blind (DB) peer review on bias against authors when compared to single-blind (SB) peer review in scientific publications. Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, a search of databases including Pubmed, Embase, and Web of Science, without language or date restrictions, was conducted to identify original research studies comparing peer-review outcomes between DB and SB methods based on any of the following author characteristics: gender, race, geographic location, personal prestige, institutional prestige. Studies were ranked Level I, II, or III for quality of evidence based on a modified version of the Oxford Center for Evidence-Based Medicine 2011 Levels of Evidence. Of 29 studies included, five level I studies, the highest quality evidence, showed that in SB peer review, the following author characteristics were associated with more positive outcomes: male gender, White race, location of the US or North America, well-published or known in their field, or affiliation with prestigious institutions. The evidence of whether DB peer review resulted in better outcomes for authors lacking these characteristics was more discordant, possibly due to lack of effective blinding or due to unblinded editor decisions. However, if bias reduction is defined as elimination of advantages afforded to only certain types of authors, DB peer review should be considered.Keywords
This publication has 47 references indexed in Scilit:
- Does double‐blind peer review reduce bias? Evidence from a top computer science conferenceJournal of the Association for Information Science and Technology, 2021
- Gender differences in peer review outcomes and manuscript impact at six journals of ecology and evolutionEcology and Evolution, 2019
- Does single blind peer review hinder newcomers?Scientometrics, 2017
- Single-blind vs Double-blind Peer Review in the Setting of Author PrestigeJAMA, 2016
- Ensuring the Quality, Fairness, and Integrity of Journal Peer Review: A Possible Role of EditorsScience and Engineering Ethics, 2015
- The reviewer in the mirror: examining gendered and ethnicized notions of reciprocity in peer reviewScientometrics, 2014
- Bias in peer reviewJournal of the American Society for Information Science and Technology, 2012
- Effect of Blinded Peer Review on Abstract AcceptanceJAMA, 2006
- Effect of Blinding and Unmasking on the Quality of Peer ReviewJAMA, 1998
- The Effects of Blinding on Acceptance of Research Papers by Peer ReviewJAMA, 1994