生成式语言模型在自动写作评估中的早期综述:自动作文评分与反馈生成领域的进展、挑战及方向
Authors:
- Yue HuangYHYue Huang
- Corey PalermoCPCorey Palermo
- Ruitao LiuRLRuitao Liu
- Yong HeYHYong He
- 1 June 2025
- journal article
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 6, 6
Abstract
自动写作评估(AWE)长期以来在写作测评与教学中发挥着重要作用,但现有系统在捕捉学生写作中更深层次的修辞结构与教学相关特征方面仍存在不足。近年来,生成式语言模型(GLM)如 GPT 和 Llama 的快速发展为 AWE带来新机遇,但其效能尚未得到充分验证。本综述综合了 29 项关于自动作文评分的研究和 14 项关于自动写作反馈生成的研究,系统探讨了 GLM 在提示工程、微调与适应性策略中的应用。研究表明,GLM 在模拟人类评分与生成符合评分标准的反馈方面展现出潜力,但公平性、效度与伦理等关键问题仍亟待解决。GLM 有望显著提升 AWE 系统的表现,但前提是未来研究需建构稳健的评估框架与保障机制,以确保其在教育实践中负责任、公平地应用。Keywords
This publication has 54 references indexed in Scilit:
- Automated Essay Scoring With GPT ‐4 for a Local Placement Test: Investigating Prompting Strategies, Intra‐Rater Reliability, and Alignment With Human ScoresTESOL Quarterly, 2025
- Comparing ChatGPT's correction and feedback comments with that of educators in the context of primary students' short essays written in English and GreekEducation and Information Technologies, 2024
- ChatGPT as an automated essay scoring tool in the writing classrooms: how it compares with human scoringEducation and Information Technologies, 2024
- The Impact of Example Selection in Few-Shot Prompting on Automated Essay Scoring Using GPT Models2024
- To resist it or to embrace it? Examining ChatGPT’s potential to support teacher feedback in EFL writingEducation and Information Technologies, 2023
- Prompt Engineering with ChatGPT: A Guide for Academic WritersAnnals of Biomedical Engineering, 2023
- A review of deep-neural automated essay scoring modelsBehaviormetrika, 2021
- The nature of feedback: how different types of peer feedback affect writing performanceInstructional Science, 2008
- COMPUTER ANALYSIS OF ESSAY CONTENT FOR AUTOMATED SCORE PREDICTION: A PROTOTYPE AUTOMATED SCORING SYSTEM FOR GMAT ANALYTICAL WRITING ASSESSMENT ESSAYSETS Research Report Series, 1998
- Formative assessment and the design of instructional systemsInstructional Science, 1989