Abstract
Objectives: To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations.Design: Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys.Setting: BioMed Central biology and medical journals.BMC Infectious DiseasesandBMC Microbiologyare similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. TheJournal of Inflammationhas operated under both peer review models.Sample: Two hundred reviewer reports submitted toBMC Infectious Diseases, 200 reviewer reports submitted toBMC Microbiologyand 400 reviewer reports submitted to theJournal of Inflammation.Results: For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (pBMC Infectious Diseases, BMC Microbiologyand theJournal of Inflammation). ForBMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than forBMC Microbiology(p=0.042). For theJournal of Inflammation, the quality of reports was the same irrespective of the peer review model used.Conclusions: Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports forBMC Infectious Diseaseswere of higher quality than single-blind reports forBMC Microbiology.There was no difference in quality of peer review in theJournal of Inflammationunder open peer review compared with single blind.