Models and Mechanisms for Evaluating Government-Funded Research
- 1 December 2007
- journal article
- research article
- Published by SAGE Publications in American Journal of Evaluation
- Vol. 28 (4) , 437-457
Abstract
This research describes, classifies, and comparatively evaluates national models and mechanisms used to evaluate research and allocate research funding in 16 countries. Although these models and mechanisms vary widely in terms of how research is evaluated and financed, nearly all share the common characteristic of relating funding to some measure of past performance. Each of these 16 national models and mechanisms were rated by independent, blinded panels of professional researchers and evaluators in two countries on more than 25 quality indicators. The national models were then ranked using the panels' ratings, in terms of their validity, credibility, utility, cost-effectiveness, and ethicality. The highest ratings were received by nations using large-scale research assessment exercises. Bulk funding and indicator-driven models received substantially lower ratings. Implications for research evaluation practice and policy are considered and discussed.Keywords
This publication has 17 references indexed in Scilit:
- Organizational Use of EvaluationsEvaluation, 2006
- Quality, Context, and UseAmerican Journal of Evaluation, 2005
- University Research Evaluation and Funding: An International ComparisonMinerva, 2003
- The Agora and the Role of Research EvaluationEvaluation, 2003
- On the Principles of Comparative EvaluationEvaluation, 2002
- How Modern Democracies Are Shaping Evaluation and the Emerging Challenges for EvaluationAmerican Journal of Evaluation, 2001
- The Metaevaluation ImperativeAmerican Journal of Evaluation, 2001
- Assessing federally-supported academic research in the United StatesResearch Evaluation, 2000
- Processes and mechanisms for evaluating and monitoring research outcomes from higher education: international comparisonsResearch Evaluation, 2000
- A case study of evaluation auditing as metaevaluationEvaluation and Program Planning, 1992