Survey and Analysis for the Challenges in Computer Science to the Automation of Grading Systems
Open Access
- 30 August 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 58 (1) , 1-37
Abstract
Assessment is essential to educational system. Automatic grading reduces the time and effort taken by tutors to assess the answers written by the students. To understand recent computational methods used for automatic grading, a review has been conducted. 4,084 articles were initially identified using a keyword search. After filtering, the number was reduced to 57. It was found that statistical models are normally used in Automatic-Short-Answer-Grading (ASAG); vector-based similarity measures are the most popular among projects; pilot datasets are mostly used; standard datasets for evaluation are missing. Evidence shows that machine learning and deep learning are most popularly adopted methods and generative AI, e.g., LLMs and ChatGPT are also jump to the chance, which indicates that integrating AI in education is an inevitable trend. Also, most investigations prefer to adopt multiple approaches to improve computational quality, dataset analysis, and evaluation results. The identified research gaps will be a useful reference guide to users/researchers beneficial to formative/summative assessment. We concluded that the presented outcome, analysis and discussions are informative to academia and pedagogical practitioners who are interested in further developing/using ASAG systems. Although research into ASAG is still rudimentary, it is a promising area with impact on academic circles/commercially educational markets.Keywords
This publication has 90 references indexed in Scilit:
- FusionASAG: An LLM-Enhanced Automatic Short Answer Grading Model for Subjective Questions in Online Education2025
- Automatic Short Answer Grading Using Corpus-Based Semantic Similarity Measurements2020
- Strategies for Deploying Unreliable AI Graders in High-Transparency High-Stakes Exams2020
- Automatic Grading System Using Sentence-BERT Network2020
- Automated Short-Answer Grading Using Deep Neural Networks and Item Response Theory2020
- A Machine Learning Grading System Using Chatbots2019
- Sentence Level or Token Level Features for Automatic Short Answer Grading?: Use Both2018
- Automatic Chinese Reading Comprehension Grading by LSTM with Knowledge Adaptation2018
- Can Short Answers to Open Response Questions Be Auto-Graded Without a Grading Rubric?2017
- Cross-language plagiarism detectionLanguage Resources and Evaluation, 2010