Measuring and comparing the performance of Portuguese secondary schools
- 30 October 2009
- journal article
- Published by Emerald Publishing in International Journal of Productivity and Performance Management
- Vol. 58 (8) , 767-786
Abstract
Purpose – This paper aims to discuss methods for measuring and comparing the performance of Portuguese schools, confronting metric and practice benchmarking exercises. Design/methodology/approach – Data on the schools was collected within the context of a programme for school evaluation launched by the Ministry of Education in 2007. The paper first uses a non-parametric technique, data envelopment analysis, to assess the sample of schools using the data collected, taking a value-added approach. The results obtained are compared with the results obtained by the panels of evaluators within the national evaluation programme of schools. Findings – The paper concludes that the performance of the schools under the metric benchmarking exercise does vary substantially. However, the results do not correlate with the judgements made by the panels of assessors regarding schools' results. This might be because assessors find it difficult to take a value-added approach and instead assess schools mostly on output measures, such as exam classifications and graduation rates, having difficulty in taking into account pupils' socio-economic background and other variables not under the control of the school. Research limitations/implications – The paper focuses on the Portuguese context, and its findings might not be directly applicable to other contexts. Also, if other quantitative and qualitative methods were used, other results might have been obtained. Practical implications – Although the study is focused on the Portuguese context, contributing towards a better understanding of Portuguese secondary school performance, it is believed it will be helpful to inform the debate on school evaluation, performance improvement and policy setting in other contexts. Originality/value – The paper concludes by arguing for metric benchmarking exercises of the type proposed, to inform schools, evaluators and policy decision-makers, in combination with practice benchmarking exercises, which are better suited for qualitative aspects of performance.Keywords
This publication has 14 references indexed in Scilit:
- Quantifying Quality: Can Quantitative Data (“Metrics”) Explain the 2001 RAE Ratings for Social Policy and Administration?Social Policy & Administration, 2003
- Measuring and managing educational performanceJournal of the Operational Research Society, 2003
- Pitfalls and protocols in DEAEuropean Journal of Operational Research, 2001
- Performance Measurement and Data Envelopment AnalysisOR Insight, 2000
- Chapter 12 New uses of DEA and statistical regressions for efficiency evaluation and estimation — with an illustrative application to public secondary schools in TexasAnnals of Operations Research, 1996
- The judge, the model of the judge, and the model of the judged as judge: Analyses of the UK 1992 research assessment exercise data for business and management studiesOmega, 1996
- Slants on Slopes: Using Multi‐level Models to Investigate Differential School Effectiveness and its Impact on Pupils’ Examination ResultsSchool Effectiveness and School Improvement, 1991
- Developing Models of Educational AccountabilityOxford Review of Education, 1988
- Performance Assessment in the Education Sector: educational and economic perspectivesOxford Review of Education, 1987
- Measuring the efficiency of decision making unitsEuropean Journal of Operational Research, 1978