Demythologising A level Exam Standards
- 6 January 2021
- journal article
- research article
- Published by Taylor & Francis in Research Papers in Education
- Vol. 37 (6) , 875-906
Abstract
There are two major myths concerning A level exam standards in England. First, the Ancient Myth, which insists that standards were norm-referenced until the 1980s, when they transitioned to being criterion-referenced. Second, the Modern Myth, which insists that standards transitioned again, during the 2010s, to being based upon the comparable outcomes principle. The present paper debunks these myths, arguing that: except for the occasional use of comparable outcomes to bridge qualification reforms, A level standards have always been attainment-referenced; and that this has always been operationalised using a combination of methods, including both examiner judgement of exam performances and statistical expectations of cohort attainment. The paper also argues that what has changed significantly is the degree of confidence that the exam industry has placed in examiner judgement relative to statistical expectations, which has waxed and waned over time. When statistical expectations have prevailed, pass rates have tended to plateau; somewhat implausibly. When examiner judgement has prevailed, pass rates have tended to rise; also somewhat implausibly. These trends have given a false impression of principled transitions, which the paper dispels.Keywords
Funding Information
- Ofqual
This publication has 11 references indexed in Scilit:
- The Testing Charade2017
- Setting and maintaining GCSE and GCE grading standards: the case for contextualised cohort-referencingResearch Papers in Education, 2011
- Thinking About LinkingMeasurement: Interdisciplinary Research and Perspectives, 2010
- Investigating a judgemental rank‐ordering method for maintaining standards in UK examinationsResearch Papers in Education, 2008
- Instructional Technology and the Measwement of Learning Outcomes: Some Questions1Educational Measurement: Issues and Practice, 2005
- The Effects of Consistency of Performance on A Level Examiners' Judgements of StandardsBritish Educational Research Journal, 2000
- Examining standards over timeResearch Papers in Education, 1997
- Effects of Item Order and Context on Estimation of NAEP Reading ProficiencyEducational Measurement: Issues and Practice, 1991
- Describing Examination Performance: grade criteria in public examinationsEducational Studies, 1987
- Is Education Getting Better?*British Educational Research Journal, 1981