Automated Essay Evaluation Augmented with Semantic Coherence Measures
Authors:
- Kaja ZupancKZKaja Zupanc
- Zoran BosnicZBZoran Bosnic
- 1 December 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15504786,p. 1133-1138
Abstract
Manual grading of students' essays is a time-consuming, labor-intensive and expensive activity for educational institutions. It is nevertheless necessary since essays are considered to be the most useful tool to assess learning outcomes. Automated essay evaluation represents a practical solution to this task, however, its main weakness is predominant focus on vocabulary and text syntax, and limited consideration of text semantics. In this work, we propose an extension to existing automated essay evaluation systems that incorporates additional semantic attributes. We design the novel attributes by transforming sequential parts of an essay into the semantic space and measuring changes between them to estimate coherence of the text. The resulting system (called SAGE - Semantic Automated Grader for Essays) achieves significantly higher grading accuracy compared with 8 other state-of-the-art automated essay evaluation systems.Keywords
This publication has 8 references indexed in Scilit:
- A DIFFERENTIAL WORD USE MEASURE FOR CONTENT ANALYSIS IN AUTOMATED ESSAY SCORINGETS Research Report Series, 2011
- Extremely randomized treesMachine Learning, 2006
- Random ForestsMachine Learning, 2001
- An introduction to latent semantic analysisDiscourse Processes, 1998
- The Analysis of Spatial Association by Use of Distance StatisticsGeographical Analysis, 1992
- The Contiguity Ratio and Statistical MappingThe Incorporated Statistician, 1954
- Distance to Nearest Neighbor as a Measure of Spatial Relationships in PopulationsEcology, 1954
- NOTES ON CONTINUOUS STOCHASTIC PHENOMENABiometrika, 1950