Improving marking reliability of scientific writing with the Developing Understanding of Assessment for Learning programme
Authors:
- 1 August 2013
- journal article
- research article
- Published by Taylor & Francis in Assessment & Evaluation in Higher Education
- Vol. 38 (5) , 536-553
Abstract
The Developing Understanding of Assessment for Learning (DUAL) programme was developed with the dual aims of improving both the quality and consistency of feedback students receive and the students’ ability to use that feedback to improve. DUAL comprises a range of processes (including marking rubrics, sample reports, moderation discussions and peer-review activities) which support explicit knowledge exchange between staff, and between staff and students and the development of tacit knowledge of standards in all participants. This paper describes the study which quantified the extent to which the DUAL programme improved reliability and efficiency of marking of first year biology reports by a large team of laboratory demonstrators. Marker reliability increased after participation in DUAL, with demonstrators marking laboratory reports significantly closer to the marks awarded by an expert marker of the discipline. Efficiency was also improved since time taken to mark the reports did not increase significantly, despite the fact that demonstrators were adapting to a new system of marking. Demonstrators valued the programme and nominated the marking rubric, feedback code and moderation discussion as the most useful elements. The community of practice built through joint participation in the DUAL programme created a supportive working environment for demonstrators and strengthened the collaboration between the discipline and academic language and learning lecturers.Keywords
This publication has 29 references indexed in Scilit:
- Generating dialogue in assessment feedback: exploring the use of interactive cover sheetsAssessment & Evaluation in Higher Education, 2010
- The Contribution of Written Corrective Feedback to Language Development: A Ten Month InvestigationApplied Linguistics, 2009
- Marking and moderation in the UK: false assumptions and wasted resourcesAssessment & Evaluation in Higher Education, 2009
- Reconfiguring and realigning the assessment feedback processes for an undergraduate criminology degreeAssessment & Evaluation in Higher Education, 2007
- Aligning assessment with long‐term learningAssessment & Evaluation in Higher Education, 2006
- Towards conceptual clarity for ‘tacit knowledge’: a review of empirical studiesKnowledge Management Research & Practice, 2006
- “The Art of Knowing”: Social and Tacit Dimensions of Knowledge and the Limits of the Community of PracticeThe Information Society, 2005
- What makes marking reliable? Experiments with UK examinationsAssessment in Education: Principles, Policy & Practice, 2004
- Developing Procedures for Implementing Peer Assessment in Large Classes Using an Action Research ProcessAssessment & Evaluation in Higher Education, 2002
- 'I know a 2:1 when I see it': Understanding criteria for degree classifications in franchised university programmesJournal of Further and Higher Education, 2001