The Validity of Human and Computerized Writing Assessment
Author:
- 1 September 2005
- journal article
- Published by SAGE Publications in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Vol. 49 (7) , 759-763
Abstract
This paper summarizes an experiment designed to assess the validity of essay grading between holistic and analytic human graders and a computerized grader based on latent semantic analysis. The validity of the grade was gauged by the extent to which the student's knowledge of the topic correlated with the grader's expert knowledge. To assess knowledge, Pathfinder networks were generated by the student essay writers, the holistic and analytic graders, and the computerized grader. It was found that the computer generated grades more closely matched the definition of valid grading than did human generated grades.Keywords
This publication has 10 references indexed in Scilit:
- An introduction to latent semantic analysisDiscourse Processes, 1998
- Conceptual maps and simulated teaching episodes as indicators of competence in teaching elementary mathematics.Journal of Educational Psychology, 1996
- Structural representations in knowledge acquisition.Journal of Educational Psychology, 1994
- Network representations of knowledge about chemical equilibrium: Variations with achievementJournal of Research in Science Teaching, 1994
- Holistic Grading of Written Work in Introductory Psychology: Reliability, Validity, and EfficiencyTeaching of Psychology, 1991
- Assessing structural knowledge.Journal of Educational Psychology, 1991
- Reliability, Validity, and Holistic Scoring: What We Know and What We Need to KnowCollege Composition and Communication, 1990
- Network Structures in Proximity Data1989
- HolisticismCollege Composition and Communication, 1984
- The Validity of Using Holistic Scoring to Evaluate Writing: A Critical OverviewResearch in the Teaching of English, 1984