Generative AI for automated essay scoring in writing classrooms: A thematic review using CIMO framework
- 13 November 2026
- journal article
- Published by SAGE Publications in RELC Journal
Abstract
This study reviewed empirical research on generative artificial intelligence (GenAI)–based automated scoring using the Context–Intervention–Mechanism–Outcome framework. Descriptive quantitative evidence mapping synthesized findings from 47 studies published between 2023 and 2025. The results showed that research focused largely on tertiary English as a Second or Foreign Language context and English academic writing, with rubric-based and hybrid human–artificial-intelligence scoring models dominating current practice. Evidence indicates that several studies reported substantial agreement with human raters, while individual studies also described improvements in scoring efficiency and feedback delivery. However, reliability remained sensitive to several factors, and concerns persisted regarding score instability, higher-order writing assessment, fairness, transparency, and ethics. The review suggests that GenAI-based scoring has substantial potential but also presents important risks that require careful implementation and thorough consideration of its implications.Funding Information
- Ton Duc Thang University, Vietnam
This publication has 14 references indexed in Scilit:
- Generative artificial intelligence for automated writing evaluation: A systematic review of trends, efficacy, and challengesAssessing Writing, 2026
- Exploring the Potential of ChatGPT for Evaluating English Essays in a Criterion‐Based AssessmentTESOL Quarterly, 2025
- Generative AI tools and empowerment in L2 academic writingSystem, 2025
- Using generative artificial intelligence as an automated essay scoring tool: a comparative studyInnovation in Language Learning and Teaching, 2025
- A survey on deep learning-based automated essay scoring and feedback generationArtificial Intelligence Review, 2024
- Generative AI in education: ChatGPT-4 in evaluating students’ written responsesInnovations in Education and Teaching International, 2024
- Can AI provide useful holistic essay scoring?Computers and Education: Artificial Intelligence, 2024
- Applying large language models and chain-of-thought for automatic scoringComputers and Education: Artificial Intelligence, 2024
- Fine-tuning ChatGPT for automatic scoringComputers and Education: Artificial Intelligence, 2024
- Computer Applications in Second Language Acquisition2001