AI ‐Driven Intelligent Feedback System for Enhancing Self‐Assessment Accuracy in Higher Education Writing
Authors:
- 10 December 2025
- journal article
- Published by Wiley in Expert Systems
- Vol. 43 (1)
Abstract
With the rapid advancement of generative artificial intelligence, large language models (LLMs) have become increasingly integrated into education, particularly for automated formative feedback and writing assessment. This study introduces and evaluates an AI‐driven intelligent feedback system aimed at promoting sustainable and inclusive practices in higher education. It does so by delivering cost‐effective feedback in under‐resourced contexts and adaptive guidance for diverse learners. The system is built on transformer‐based models (BERT and RoBERTa) to support personalised writing evaluation and feedback generation. The system aims to improve students’ self‐assessment accuracy (SAA), a critical factor for self‐regulated learning, while addressing the challenge of delivering high‐quality feedback efficiently in under‐resourced contexts. A quasi‐experimental design was employed to examine the effects of LLM‐generated feedback (LLMF) on students’ SAA and to investigate how these effects vary by initial ability. Results indicated no significant group‐level difference in posttest SAA between the experimental and control groups. More importantly, interaction analysis revealed a significant moderating effect of Initial Self‐Assessment Accuracy (ISAA). Students with lower baseline accuracy benefited substantially from LLMF, while those with higher baseline SAA showed limited change. This compensatory effect highlights the potential of LLMF to reduce inequities in self‐regulated learning. These findings demonstrate the potential of AI‐driven feedback systems to cost‐effectively reduce calibration gaps and foster metacognitive development. By embedding adaptive and personalised mechanisms, such systems advance educational equity and promote scalable personalised learning. They also contribute to the broader agenda of intelligent and sustainable education.Keywords
This publication has 38 references indexed in Scilit:
- Students ignore their mistakes: Elaborated error feedback processing in a digital learning systemContemporary Educational Psychology, 2025
- Fine-tuning ChatGPT for automatic scoringComputers and Education: Artificial Intelligence, 2024
- Using LLMs to bring evidence-based feedback into the classroom: AI-generated feedback increases secondary students’ text revision, motivation, and positive emotionsComputers and Education: Artificial Intelligence, 2023
- The role of feedback on students’ diagramming: Effects on monitoring accuracy and text comprehensionContemporary Educational Psychology, 2023
- Calibrating calibration: A meta-analysis of learning strategy instruction interventions to improve metacognitive monitoring accuracy.Journal of Educational Psychology, 2022
- Learning to calibrate: Providing standards to improve calibration accuracy for different performance levelsApplied Cognitive Psychology, 2019
- Bridging Cognitive Load and Self-Regulated Learning Research: A complementary approach to contemporary issues in educational researchLearning and Instruction, 2017
- Supporting Learners' Agentic Engagement With Feedback: A Systematic Review and a Taxonomy of Recipience ProcessesEducational Psychologist, 2016
- Poor Metacomprehension Accuracy as a Result of Inappropriate Cue UseDiscourse Processes, 2010
- Type/Token Ratios: what do they really tell us?Journal of Child Language, 1987