How well can GenAI (GPT-4) provide written corrective feedback on English-language learners’ writing?
- 26 March 2025
- journal article
- Published by Liverpool University Press in International Journal of English for Academic Purposes: Research and Practice
- Vol. 5 (1) , 7-26
Abstract
Providing written corrective feedback (WCF) on English-language learners’ (ELLs) writing is an efficacious, but time-consuming practice in English for Academic Purposes (EAP). Advances in generative artificial intelligence (GenAI), such as large language models (LLMs) may afford EAP language educators time-saving tools for providing WCF. In this study, we investigate the capability of GPT-4 Turbo, a LLM, in providing WCF on ELLs’ writing, and compare the feedback provided by GPT-4 with feedback provided by two experienced English-language educators. Data came from teacher and GPT-4 generated feedback on fifty ELL writing samples, collected from two classes at an intensive English programme for non-matriculated college ELL students. We explored the types and numbers of error marking codes utilized, the number of error codes used correctly and incorrectly, and the number of errors missed by the teachers and GPT-4. We found GPT-4 to be less reliable and accurate than the two trained language educators. Both teachers and GPT-4 used error marking codes correctly and incorrectly, as well as missed errors in student writing all together. We conclude, however, that if LLMs continue to improve at the current rate, with better prompt engineering, GenAI may soon allow language educators to share the time-consuming burden of providing WCF on students’ writing. This article was published open access under a CC BY-NC-ND licence: https://creativecommons.org/licenses/by-nc-nd/4.0/ .Keywords
This publication has 31 references indexed in Scilit:
- Using Artificial Intelligence in TESOL: Some Ethical and Pedagogical ConsiderationsTESOL Quarterly, 2024
- The impact of ChatGPT on L2 writing and expected responses: Voice from doctoral studentsEducation and Information Technologies, 2023
- Artificial intelligence in education: Addressing ethical challenges in K-12 settingsAI and Ethics, 2021
- A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability ResearchJournal of Chiropractic Medicine, 2016
- Automated Essay Scoring feedback for second language writers: How does it compare to instructor feedback?Assessing Writing, 2014
- Historical view of the influences of measurement and writing theories on the practice of writing assessment in the United StatesAssessing Writing, 2011
- THE EFFECTIVENESS OF FEEDBACK FOR L1‐ENGLISH AND L2‐WRITING DEVELOPMENT: A META‐ANALYSISETS Research Report Series, 2011
- The efficacy of dynamic written corrective feedback for university-matriculated ESL learnersSystem, 2011
- The effect of error correction on learners’ ability to write accuratelyJournal of Second Language Writing, 2007
- Instructional technology: A tool or a panacea?Journal of Science Education and Technology, 1995