Streetlight Effect in Post-Publication Peer Review: Are Open Access Publications More Scrutinized?
Preprint
Abstract
The Streetlight Effect represents an observation bias that occurs when individuals search for something only where it is easiest to look. Despite the significant development of Post-Publication Peer Review (PPPR) in recent years, facilitated in part by platforms such as PubPeer, existing literature has not examined whether PPPR is affected by this type of bias. In other words, if the PPPR mainly concerns publications to which researchers have direct access (eg to analyze image duplications, etc.). In this study, we compare the Open Access (OA) structures of publishers and journals among 51,882 publications commented on PubPeer to those indexed in OpenAlex database (#156,700,177). Our findings indicate that OA journals are 33% more prevalent in PubPeer than in the global total (52% for the most commented journals). This result can be attributed to disciplinary bias in PubPeer, with overrepresentation of medical and biological research (which exhibits higher levels of openness). However, after normalization, the results reveal that PPPR does not exhibit a Streetlight Effect, as OA publications, within the same discipline, are on average 16% less prevalent in PubPeer than in the global total. These results suggest that the process of scientific self-correction operates independently of publication access status.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- How do journals deal with problematic articles. Editorial response of journals to articles commented in PubPeerProfesional de la información, 2023
- Massive open index of scholarly papers launchesNature, 2022
- A psychological perspective towards understanding the objective and subjective gray zones in predatory publishingQuality & Quantity, 2022
- Classification and analysis of PubPeer comments: How a web journal club is usedJournal of the Association for Information Science and Technology, 2021
- Measuring open access publications: a novel normalized open access indicatorScientometrics, 2020
- The opacity of the PubPeer Foundation: what PubPeer’s “About” page tells usOnline Information Review, 2018
- The transformation of the academic publishing market: multiple perspectives on innovationElectronic Markets, 2017
- Stat-checking software stirs up psychologyNature, 2016
- The Oligopoly of Academic Publishers in the Digital EraPLOS ONE, 2015
- Open Access Models and their Implications for the Players on the Scientific Publishing MarketEconomic Analysis and Policy, 2009