Advancing science or advancing careers? Researchers’ opinions on success indicators
Preprint
Abstract
The way in which we assess researchers has been under the radar in the past few years. Critics argue that current research assessments focus on productivity and that they increase unhealthy pressures on scientists. Yet, the precise ways in which assessments should change is still open for debate. We circulated a survey with Flemish researchers to understand how they work, and how they would rate the relevance of specific indicators used in research assessments. We found that most researchers worked far beyond their expected working schedule. We also found that, although they spent most of their time doing research, respondents wished they could dedicate more time to it and spend less time writing grants and performing other activities such as administrative duties and meetings. When looking at success indicators, we found that indicators related to openness, transparency, quality, and innovation were perceived as highly important in advancing science, but as relatively overlooked in career advancement. Conversely, indicators which denoted of prestige and competition were generally rated as important to career advancement, but irrelevant or even detrimental in advancing science. Open comments from respondents further revealed that, although indicators which indicate openness, transparency, and quality (e.g., publishing open access, publishing negative findings, sharing data, etc.) should ultimately be valued more in research assessments, the resources and support currently in place were insufficient to allow researchers to endorse such practices. In other words, current research assessments are inadequate and ignore practices which are essential in contributing to the advancement of science. Yet, before we change the way in which researchers are being assessed, supporting infrastructures must be put in place to ensure that researchers are able to commit to the activities that may benefit the advancement of science. Submission history: The first version of this manuscript was submitted to PLOS ONE on 27th June 2020. Revisions after peer-review were submitted on 4th October 2020 and 20th November 2020.Keywords
All Related Versions
- Published version: PLOS ONE, 16 (2), e0243664.
This publication has 24 references indexed in Scilit:
- Young scientists under pressure: what the data showNature, 2016
- Validity and reproducibility of self‐reported working hours among Japanese male employeesJournal of Occupational Health, 2016
- How do scientists perceive the current publication culture? A qualitative focus group interview study among Dutch biomedical researchersBMJ Open, 2016
- Burning Out Faculty at Doctoral Research UniversitiesStress and Health, 2015
- Bibliometrics: The Leiden Manifesto for research metricsNature, 2015
- Analyzing and Interpreting Data From Likert-Type ScalesJournal of Graduate Medical Education, 2013
- Flanders overrates impact factorsNature, 2013
- On the time spent preparing grant proposals: an observational study of Australian researchersBMJ Open, 2013
- The academic birth rateEMBO Reports, 2011
- Modifying publication practices in response to funding formulasResearch Evaluation, 2003