Performance-based publisher ratings and the visibility/impact of books: Small fish in a big pond, or big fish in a small pond?
Open Access
- 15 July 2021
- journal article
- research article
- Published by MIT Press in Quantitative Science Studies
- Vol. 2 (2) , 588-615
Abstract
This study compares publisher ratings to the visibility and impact of individual books, based on a 2017 dataset from three Nordic PRFS systems (Denmark, Norway, and Finland). Although there are Journal Impact Factors (JIFs) for journals, there is no similar indicator for book publishers. National publisher lists are used instead to account for the general 'quality' of books, leading to institutional rewards. But, just as the JIF is not recommended as proxy for the ‘citedness’ of a paper, a publisher rating is also not recommended as proxy for the impact of an individual book. We introduce a small fish in a big pond versus big fish in a small pond metaphor, where a ‘fish’ is a book and ‘the pond’ represents its publishing house. We investigate how books fit on this metaphorical fish and pond continuum, using WorldCat holdings (visibility) and Google scholar citations (impact), and test other variables to determine their predictive value with respect to these two indicators. Our statistics show that publisher levels do not have predictive value, when other variables are held constant. This has implications for PRFSs and book evaluations in general, as well as ongoing developments related to a newly proposed international publisher registry.Keywords
This publication has 45 references indexed in Scilit:
- Multilingual publishing in the social sciences and humanities: A seven‐country European studyJournal of the Association for Information Science and Technology, 2020
- Reviewing, Indicating, and Counting Books for Modern Research Evaluation Systems2019
- An Overview of Author-Level Indicators of Research Performance2019
- Libcitations, worldcat, cultural impact, and fameJournal of the Association for Information Science and Technology, 2018
- New university presses in theUK: Accessing a missionLearned Publishing, 2016
- Can we rank scholarly book publishers? A bibliometric experiment with the field of historyJournal of the Association for Information Science and Technology, 2014
- A label for peer‐reviewed booksJournal of the American Society for Information Science and Technology, 2012
- The source normalized impact per paper is a valid and sophisticated indicator of journal citation impactJournal of the American Society for Information Science and Technology, 2010
- Libcitations: A measure for comparative assessment of book publications in the humanities and social sciencesJournal of the American Society for Information Science and Technology, 2009
- The History and Meaning of the Journal Impact FactorJAMA, 2006