Measuring Comparability of Standards between Subjects: why our statistical techniques do not make the grade
- 1 September 1997
- journal article
- Published by Wiley in British Educational Research Journal
- Vol. 23 (4) , 433-449
Abstract
In the past few years the examination boards in Britain have witnessed a renewed interest from external bodies in the notion of comparability of grading standards between different subjects. This interest has stemmed from concern with findings, from statistical techniques for comparison, suggesting that public examinations in different subjects are not comparable. This article focuses on one of these techniques — the Subject‐Pair Analysis — in an attempt to demonstrate that reliance on the statistical comparison of standards between subjects is misplaced. Fundamental assumptions underlying the Subject‐Pair Analysis, and related analyses, are made explicit and then challenged both in principle and from operational data. These techniques cannot be assumed even to approximate a valid representation of ‘the problem’ of between‐subject comparability because they are inappropriate for dealing with the kind of data that our examinations generate.Keywords
This publication has 7 references indexed in Scilit:
- The Comparability of Different Subjects in Public Examinations: a theoretical and practical critiqueOxford Review of Education, 1996
- Monitoring A level standards: tests, grades and other approximationsThe Curriculum Journal, 1996
- A Didactic Explanation of Item Bias, Item Impact, and Item Validity From a Multidimensional PerspectiveJournal of Educational Measurement, 1992
- Subject Preferences, Sex Differences and Comparability of StandardsBritish Educational Research Journal, 1982
- A study of the comparability of external examinations in different subjectsResearch in Education, 1976
- SUBJECT PREFERENCE AND CHOICE IN CO‐EDUCATIONAL AND SINGLE‐SEX SECONDARY SCHOOLSBritish Journal of Educational Psychology, 1975
- THE RELATIVE STANDARDS OF SUBJECT EXAMINATIONSResearch Intelligence, 1975