Funding decisions, peer review, and scientific excellence in physical sciences, chemistry, and geosciences
- 21 August 2012
- journal article
- research article
- Published by Oxford University Press (OUP) in Research Evaluation
- Vol. 21 (3) , 189-198
Abstract
This article presents an analysis of the funding policies of three research councils at the Netherlands Organization for Scientific Research (NWO). The key issue is the extent to which these three councils recognized scientific excellence, and particularly, whether they succeeded in rewarding the grants of the most successful and influential researchers. Data on grant applications provided by NWO for the time period 2000–4 were combined with bibliometric indicators of past research performance of applicants and non-applicants derived from Thomson Reuters’ Web of Science. It is found that the three councils did support scientific excellence, in the following sense. Firstly, they tend to attract research proposals from the better groups in the fields they cover. Secondly, the applicants whose submitted proposals were granted—and the research groups they represent—tend to generate a higher citation impact at their international research fronts than those whose submissions were rejected. Although there are some differences in the outcomes among the three councils, this conclusion is valid for each council. On the other hand, for applicants with more than three granted applications we observed a rather variable pattern: in one council these performed at the same level as researchers whose applications were all rejected; in another council these applicants outperformed the rejected applicants; and in another council the number of applicants with more than three granted applications was very small.Keywords
This publication has 8 references indexed in Scilit:
- Past performance, peer review and project selection: a case study in the social and behavioral sciencesResearch Evaluation, 2009
- Different — not just by label: research-oriented academic careers in GermanyResearch Evaluation, 2009
- An assessment of selection processes among candidates for public research grants: the case of the Ramón y Cajal Programme in SpainResearch Evaluation, 2009
- Indicators for comparative analysis of public project funding: concepts, implementation and evaluationResearch Evaluation, 2007
- Selecting scientific excellence through committee peer review - A citation analysis of publications previously published to approval or rejection of post-doctoral research fellowship applicantsScientometrics, 2006
- The effects of changes in the funding structure of the Flemish universities on their research capacity, productivity and impact during the 1980's and early 1990'sScientometrics, 1998
- New bibliometric tools for the assessment of national research performance: Database description, overview of indicators and first applicationsScientometrics, 1995
- Predictive Validity of Quality Ratings of National Science Foundation Graduate FellowsEducational and Psychological Measurement, 1994