Beyond correctness: development and validation of concept-based categorical scoring rubrics for diagnostic purposes
- 15 April 2015
- journal article
- research article
- Published by Taylor & Francis in Educational Psychology
- Vol. 36 (6) , 1083-1101
Abstract
Diagnostic assessment approaches intend to provide fine-grained reports of what students know and can do, focusing on their areas of strengths and weaknesses. However, current application of such diagnostic approaches is limited by the scoring method for item responses; important diagnostic information, such as type of errors and strategy use is lost or neglected when item-level responses are scored only for correctness. The purpose of this paper is to introduce a scoring method that classifies responses into concept-based nominal categories. In this paper, we describe the methodology of developing concept-based rubrics, and present an empirical examination of the construct validity of the scores in comparison to the scores based on conventional correctness rubrics. Utilising Multiple Correspondence Analysis, the results show that the categorical scores do not only reflect what the correctness scores capture, but also provide additional information that communicates aspects of student performance crucial for learning but neglected by conventional scoring methods.Keywords
This publication has 31 references indexed in Scilit:
- Formative assessment: a critical reviewAssessment in Education: Principles, Policy & Practice, 2011
- Diagnosis of Subtraction Bugs Using Bayesian NetworksApplied Psychological Measurement, 2010
- A review of rubric use in higher educationAssessment & Evaluation in Higher Education, 2010
- A Cognitive Diagnosis Model for Cognitively Based Multiple-Choice OptionsApplied Psychological Measurement, 2009
- Chapter 9 : Addressing the “Two Disciplines” Problem: Linking Theories of Cognition and Learning With Assessment and Instructional PracticeReview of Research in Education, 1999
- Multiple Correspondence Analysis of Multiple Choice Experiment DataJournal of Marketing Research, 1990
- A Review of the Research on Student Conceptions in Mathematics, Science, and ProgrammingReview of Research in Education, 1990
- Images and Definitions for the Concept of FunctionJournal for Research in Mathematics Education, 1989
- A Probabilistic Model for Diagnosing Misconceptions By The Pattern Classification ApproachJournal of Educational Statistics, 1985
- Error Analysis in Mathematics EducationJournal for Research in Mathematics Education, 1979