Juan Escalante
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Juan Escalante has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
Alex Barrett
College of Education, Florida State University, Tallahassee, USA
1 shared publicationAustin Pack
Faculty of Education and Social Work, Brigham Young University-Hawaii, Laie, USA
1 shared publication- Austin Pack
Faculty of Education & Social Work , Brigham Young University-Hawaii , Laie , USA
1 shared publication - K. James Hartshorn
Brigham Young University
1 shared publication - Natasha Gillette
Brigham Young University-Hawaii, U.S.A.
1 shared publication
Latest Publications
- 26 March 2025
- Published by Liverpool University Press in International Journal of English for Academic Purposes: Research and Practice
- Vol. 5 (1) , 7-26
How well can GenAI (GPT-4) provide written corrective feedback on English-language learners’ writing?
Providing written corrective feedback (WCF) on English-language learners’ (ELLs) writing is an efficacious, but time-consuming practice in English for Academic Purposes (EAP). Advances in generative artificial intelligence (GenAI), such as large language models (LLMs) may afford EAP language educators time-saving tools for providing WCF. In this study, we investigate the capability of GPT-4 Turbo, a LLM, in providing WCF on ELLs’ writing, and compare the feedback provided by GPT-4 with feedback provided by two experienced English-language educators. Data came from teacher and GPT-4 generated feedback on fifty ELL writing samples, collected from two classes at an intensive English programme for non-matriculated college ELL students. We explored the types and numbers of error marking codes utilized, the number of error codes used correctly and incorrectly, and the number of errors missed by the teachers and GPT-4. We found GPT-4 to be less reliable and accurate than the two trained language educators. Both teachers and GPT-4 used error marking codes correctly and incorrectly, as well as missed errors in student writing all together. We conclude, however, that if LLMs continue to improve at the current rate, with better prompt engineering, GenAI may soon allow language educators to share the time-consuming burden of providing WCF on students’ writing. This article was published open access under a CC BY-NC-ND licence: https://creativecommons.org/licenses/by-nc-nd/4.0/ .
- 26 March 2025
- Published by Liverpool University Press in International Journal of English for Academic Purposes: Research and Practice
- Vol. 5 (1) , 7-26
How well can GenAI (GPT-4) provide written corrective feedback on English-language learners’ writing?
Providing written corrective feedback (WCF) on English-language learners’ (ELLs) writing is an efficacious, but time-consuming practice in English for Academic Purposes (EAP). Advances in generative artificial intelligence (GenAI), such as large language models (LLMs) may afford EAP language educators time-saving tools for providing WCF. In this study, we investigate the capability of GPT-4 Turbo, a LLM, in providing WCF on ELLs’ writing, and compare the feedback provided by GPT-4 with feedback provided by two experienced English-language educators. Data came from teacher and GPT-4 generated feedback on fifty ELL writing samples, collected from two classes at an intensive English programme for non-matriculated college ELL students. We explored the types and numbers of error marking codes utilized, the number of error codes used correctly and incorrectly, and the number of errors missed by the teachers and GPT-4. We found GPT-4 to be less reliable and accurate than the two trained language educators. Both teachers and GPT-4 used error marking codes correctly and incorrectly, as well as missed errors in student writing all together. We conclude, however, that if LLMs continue to improve at the current rate, with better prompt engineering, GenAI may soon allow language educators to share the time-consuming burden of providing WCF on students’ writing. This article was published open access under a CC BY-NC-ND licence: https://creativecommons.org/licenses/by-nc-nd/4.0/ .
- Top Cited PapersOpen Access
- 27 October 2023
- Published by Springer Nature in International Journal of Educational Technology in Higher Education
- Vol. 20 (1) , 1-20
AI-generated feedback on writing: insights into efficacy and ENL student preference
The question of how generative AI tools, such as large language models and chatbots, can be leveraged ethically and effectively in education is ongoing. Given the critical role that writing plays in learning and assessment within educational institutions, it is of growing importance for educators to make thoughtful and informed decisions as to how and in what capacity generative AI tools should be leveraged to assist in the development of students’ writing skills. This paper reports on two longitudinal studies. Study 1 examined learning outcomes of 48 university English as a new language (ENL) learners in a six-week long repeated measures quasi experimental design where the experimental group received writing feedback generated from ChatGPT (GPT-4) and the control group received feedback from their human tutor. Study 2 analyzed the perceptions of a different group of 43 ENLs who received feedback from both ChatGPT and their tutor. Results of study 1 showed no difference in learning outcomes between the two groups. Study 2 results revealed a near even split in preference for AI-generated or human-generated feedback, with clear advantages to both forms of feedback apparent from the data. The main implication of these studies is that the use of AI-generated feedback can likely be incorporated into ENL essay evaluation without affecting learning outcomes, although we recommend a blended approach that utilizes the strengths of both forms of feedback. The main contribution of this paper is in addressing generative AI as an automatic essay evaluator while incorporating learner perspectives.
- 27 October 2023
- Published by Springer Nature in International Journal of Educational Technology in Higher Education
- Vol. 20 (1) , 1-20
Top Cited PapersOpen AccessAI-generated feedback on writing: insights into efficacy and ENL student preference
The question of how generative AI tools, such as large language models and chatbots, can be leveraged ethically and effectively in education is ongoing. Given the critical role that writing plays in learning and assessment within educational institutions, it is of growing importance for educators to make thoughtful and informed decisions as to how and in what capacity generative AI tools should be leveraged to assist in the development of students’ writing skills. This paper reports on two longitudinal studies. Study 1 examined learning outcomes of 48 university English as a new language (ENL) learners in a six-week long repeated measures quasi experimental design where the experimental group received writing feedback generated from ChatGPT (GPT-4) and the control group received feedback from their human tutor. Study 2 analyzed the perceptions of a different group of 43 ENLs who received feedback from both ChatGPT and their tutor. Results of study 1 showed no difference in learning outcomes between the two groups. Study 2 results revealed a near even split in preference for AI-generated or human-generated feedback, with clear advantages to both forms of feedback apparent from the data. The main implication of these studies is that the use of AI-generated feedback can likely be incorporated into ENL essay evaluation without affecting learning outcomes, although we recommend a blended approach that utilizes the strengths of both forms of feedback. The main contribution of this paper is in addressing generative AI as an automatic essay evaluator while incorporating learner perspectives.