Exploring effective methods for automated essay scoring of non-native speakers
Open Access
- 1 October 2023
- journal article
- research article
- Published by Bastas Publications in Contemporary Educational Technology
- Vol. 15 (4) , ep475
Abstract
Automated essay scoring (AES) has become a valuable tool in educational settings, providing efficient and objective evaluations of student essays. However, the majority of AES systems have primarily focused on native English speakers, leaving a critical gap in the evaluation of non-native speakers’ writing skills. This research addresses this gap by exploring the effectiveness of automated essay-scoring methods specifically designed for non-native speakers. The study acknowledges the unique challenges posed by variations in language proficiency, cultural differences, and linguistic complexities when assessing non-native speakers’ writing abilities. This work focuses on the automated student assessment prize and Khon Kaen University academic English language test dataset and presents an approach that leverages variants of the long short-term memory network model to learn features and compare results with the Kappa coefficient. The findings demonstrate that the proposed framework and approach, which involve joint learning of different essay representations, yield significant benefits and achieve results comparable to state-of-the-art deep learning models. These results suggest that the novel text representation proposed in this paper holds promise as a new and effective choice for assessing the writing tasks of non-native speakers. The result of this study can apply to advance educational assessment practices and promote equitable opportunities for language learners worldwide by enhancing the evaluation process for non-native speakersKeywords
This publication has 46 references indexed in Scilit:
- Open innovation in software engineering: a systematic mapping studyEmpirical Software Engineering, 2015
- Automated Scoring for theTOEFLJunior®Comprehensive Writing and Speaking TestETS Research Report Series, 2015
- IBLStreams: a system for instance-based classification and regression on data streamsEvolving Systems, 2012
- A Framework for Evaluation and Use of Automated ScoringEducational Measurement: Issues and Practice, 2012
- Supervised Sequence Labelling2012
- USE OF E‐RATER® IN SCORING OF THE TOEFL IBT® WRITING TESTETS Research Report Series, 2011
- Design of an Automated Essay Grading (AEG) System in Indian ContextInternational Journal of Computer Applications, 2010
- Stumping e-rater:challenging the validity of automated essay scoringComputers in Human Behavior, 2002
- On-line Grading of Student Essays: PEG goes on the World Wide WebAssessment & Evaluation in Higher Education, 2001
- Long Short-Term MemoryNeural Computation, 1997