Automated Grading of Handwritten Essays
Authors:
- Annapurna SharmaASAnnapurna Sharma
- Dinesh Babu JayagopiDJDinesh Babu Jayagopi
- 1 August 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 279-284
Abstract
Automatic grading of handwritten essays is vital in evaluating the performance of students in educational settings, particularly in situations where language experts are rare. We build a system capable of taking the input as handwritten essays in image format and outputs the grading on the scale of 0-5; 0 being the worst and 5 being the best. The overall system integrates Optical Handwriting Recognition (OHR) and Automated Essay Scoring (AES)/grading. The handwritten essay is transcribed using a network composed of Multi-Dimensional Long Short Term Memory (MDLSTM) and convolution layers. The loss function is Connectionist Temporal Classification (CTC). The AES model is a 2-layer artificial neural network with a feature set based on pretrained GloVe word vectors. The results of grading of essays are compared for transcriptions of essays received from OHR system and transcriptions of essays done manually. The mutual agreement between the two shows a Quadratic Weighted Kappa score of 0.88. The results indicate that though the current OHR systems have transcription errors but as a whole can perform well for an application like AES.Keywords
This publication has 7 references indexed in Scilit:
- Task-Independent Features for Automated Essay Grading2015
- Dropout Improves Recurrent Neural Networks for Handwriting Recognition2014
- Glove: Global Vectors for Word Representation2014
- Connectionist temporal classification2006
- Automated Scoring of Handwritten Essays Based on Latent Semantic Analysis2006
- The IAM-database: an English sentence database for offline handwriting recognitionInternational Journal on Document Analysis and Recognition (IJDAR), 2002
- An overview of character recognition focused on off-line handwritingIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2001