Are Italian research assessment exercises size-biased?
Open Access
- 5 August 2020
- journal article
- research article
- Published by Springer Nature in Scientometrics
- Vol. 125 (1) , 533-549
Abstract
Research assessment exercises have enjoyed ever-increasing popularity in many countries in recent years, both as a method to guide public funds allocation and as a validation tool for adopted research support policies. Italy’s most recently completed evaluation effort (VQR 2011–14) required each university to submit to the Ministry for Education, University, and Research (MIUR) 2 research products per author (3 in the case of other research institutions), chosen in such a way that the same product is not assigned to two authors belonging to the same institution. This constraint suggests that larger institutions, where collaborations among colleagues may be more frequent, could suffer a size-related bias in their evaluation scores. To validate our claim, we investigate the outcome of artificially splitting Sapienza University of Rome, one of the largest universities in Europe, in a number of separate partitions, according to several criteria, noting significant score increases for several partitioning scenarios.Keywords
This publication has 46 references indexed in Scilit:
- A gender analysis of top scientists’ collaboration behavior: evidence from ItalyScientometrics, 2019
- On tit for tat: Franceschini and Maisano versus ANVUR regarding the Italian research assessment exercise VQR 2011–2014Journal of Informetrics, 2017
- Refrain from adopting the combination of citation and journal metrics to grade publications, as used in the Italian national research assessment exercise (VQR 2011–2014)Scientometrics, 2016
- The VQR, Italy's second national research assessment: Methodological failures and ranking distortionsJournal of the Association for Information Science and Technology, 2015
- Investigating returns to scope of research fields in universitiesHigher Education, 2013
- Gender differences in research collaborationJournal of Informetrics, 2013
- The collaboration behaviors of scientists in Italy: A field level analysisJournal of Informetrics, 2013
- Revisiting size effects in higher education research productivityHigher Education, 2011
- National research assessment exercises: the effects of changing the rules of the game during the gameScientometrics, 2011
- The efficiency of Australian universities: a data envelopment analysisEconomics of Education Review, 2003