APAustin Pack

Austin Pack

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Austin Pack has a total of 28 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    The influence of online peer review on EFL learners’ cohesion and coherence in narrative writing

    by Junzhen Li, Yi Guan, Austin Pack, Wen Jia, Wenjie Xia, Bingyu Wang

    While online peer review’s impact on EFL argumentative writing has been widely studied, its role in shaping narrative writing remains underexplored. This study investigated changes in cohesion and coherence in EFL learners’ narrative writing following online peer review. Thirty first-year English majors in China completed a two-round narrative writing task on the Peerceptiv platform. Subjective peer ratings and objective Coh-Metrix indices were analyzed. Due to non-normal data distribution, bootstrapped paired-samples t -tests with 10,000 resamples were employed to compare writing drafts. Results revealed selective changes in cohesion and coherence indices. Subjective Peerceptiv ratings showed significant gains in Topic Sentence and Organization (cohesion), and in Emotion and Concluding Part (coherence), suggesting improvements in local and meaning-focused aspects in narrative writing. However, Focus and Transition remained unchanged, indicating EFL learners’ difficulty with text-level control. Objective Coh-Metrix analysis revealed increased use of overall (CNCALL) and causal connectives (CNCCaus), and decreased adjacent sentence stem overlap (CRFSO1) under cohesion indices, suggesting more lexical variety. Only causal cohesion (SMCAUSr) improved among coherence indices; Latent Semantic Analysis (LSA) and other situation model measures remained stable, reflecting limited influence on deeper semantic integration. These findings suggest that peer review may support cohesion and coherence development in EFL narrative writing, especially when supported by rubrics that balance local and global features. Given the limited change in deeper semantic coherence and the study’s exploratory design, future research with extended interventions and comparison groups is recommended.

  • The Effects of Artificial Intelligence-Based Dynamic Written Corrective Feedback on Second Language Writing and User Sentiment

    by K. James Hartshorn, Austin Pack

    This study investigated the efficacy of artificial intelligence-based dynamic written corrective feedback on second language writing accuracy, fluency, complexity, and functional adequacy, while also examining user sentiment for teacher and students. Utilizing Claude 3 Opus as the primary artificial intelligence tool, the research compares artificial intelligence-generated feedback to traditional teacher-provided dynamic written corrective feedback within a 15-week intensive English program involving intermediate-high learners of English as a second language ( n = 41). Using a quasi-experimental design, participants were randomly assigned to a control (teacher-based feedback) and treatment (artificial intelligence-based feedback) groups. Multiple metrics were used to assess second language writing development, including the error-free clause ratio, fluency, syntactic complexity (mean length of T-unit and clauses per T-unit), and rubric-based functional adequacy. Findings from repeated measures analysis of variance indicated that although both groups receiving dynamic written corrective feedback improved in writing accuracy, the teacher feedback group outperformed the artificial intelligence group in fluency and functional adequacy. No significant differences were observed for measures of syntactic complexity. Sentiment analysis revealed mixed reactions: although most students found artificial intelligence-based feedback helpful and easy to use, 27% of their commentary expressed concerns regarding feedback accuracy and clarity. Teachers echoed these concerns, citing some inconsistencies and student confusion. Additionally, the study compared Claude 3 Opus, Claude 3.5 Sonnet, and ChatGPT-4 in their ability to identify errors. Results suggest Sonnet may outperform Opus and ChatGPT-4, although unexpected autocorrections by Claude models introduced reliability concerns. These findings suggest that although artificial intelligence tools like Claude 3 Opus may facilitate writing accuracy gains comparable to those achieved through teacher feedback, they could inadvertently hinder other aspects of writing development. Given ongoing advancements in generative artificial intelligence, further research is warranted to explore whether newer models employing test-time compute or generative reasoning can offer improved dynamic written corrective feedback quality without compromising fluency or functional adequacy.


  • How well can GenAI (GPT-4) provide written corrective feedback on English-language learners’ writing?

    by Austin Pack, K. James Hartshorn, Juan Escalante, Natasha Gillette

    Providing written corrective feedback (WCF) on English-language learners’ (ELLs) writing is an efficacious, but time-consuming practice in English for Academic Purposes (EAP). Advances in generative artificial intelligence (GenAI), such as large language models (LLMs) may afford EAP language educators time-saving tools for providing WCF. In this study, we investigate the capability of GPT-4 Turbo, a LLM, in providing WCF on ELLs’ writing, and compare the feedback provided by GPT-4 with feedback provided by two experienced English-language educators. Data came from teacher and GPT-4 generated feedback on fifty ELL writing samples, collected from two classes at an intensive English programme for non-matriculated college ELL students. We explored the types and numbers of error marking codes utilized, the number of error codes used correctly and incorrectly, and the number of errors missed by the teachers and GPT-4. We found GPT-4 to be less reliable and accurate than the two trained language educators. Both teachers and GPT-4 used error marking codes correctly and incorrectly, as well as missed errors in student writing all together. We conclude, however, that if LLMs continue to improve at the current rate, with better prompt engineering, GenAI may soon allow language educators to share the time-consuming burden of providing WCF on students’ writing. This article was published open access under a CC BY-NC-ND licence: https://creativecommons.org/licenses/by-nc-nd/4.0/ .


  • Open Access

    Digital game-based learning’s effectiveness on EFL learners’ receptive and productive vocabulary knowledge

    by Wen Jia, Liping Zhang, Austin Pack, Yi Guan, Bin Zou

    Although digital game-based vocabulary learning (DGBVL) has received increasing attention in the past two decades, the impacts of DGBVL on the depth of word knowledge are still not well understood, especially in regard to productive vocabulary learning and DGBVL’s long-term efficacy. This study leverages a quasi-experimental research design to investigate DGBVL’s long-term effects on receptive vocabulary (RV) and productive vocabulary (PV). Forty-eight Chinese English-as-a-foreign-language (EFL) university students, assigned to the experimental and control groups, were instructed by a DGBVL approach and PowerPoint (PPT) lecturing, respectively, over the course of 18 weeks. Specifically, a mixed 2×2 repeated measures experimental design was conducted by adopting instruction type (DGBVL and PPT lecturing) and testing time (pretest and posttest) as the independent variables, with RV and PV proficiency as the respective dependent variables. The results suggest that instruction type and teaching time have significant effects on participants’ RV and PV learning achievements. However, teaching time’s effect size outweighs instruction type. The findings are highly encouraging for the use of DGBVL in the EFL classroom, as it may serve as an effective and long-lasting pedagogical tool within this context.


  • Top Cited Papers

    Using Artificial Intelligence in TESOL: Some Ethical and Pedagogical Considerations

    by Austin Pack, Jeffrey Maloney

    While recent and significant progress made in natural language processing and artificial intelligence (AI) has the potential to drastically influence the field of language education, many language educators and administrators remain unfamiliar with these recent technological advances and their pedagogical implications. The primary purpose of this paper is to raise the awareness of language educators regarding ethical and pedagogical issues stemming from student, teacher, and administrator use of generative AI tools such as large language models (LLMs) and AI chatbots. These issues include ethical ways of teaching with AI, questions of ownership, writing skills development, the accuracy and reliability of generated output, the potential to widen the educational divide, and AI bias. We conclude by offering suggestions for language educators and calling for further discussion.


  • Utilizing OpenAI's GPT‐4 for written feedback

    by Makenna Carlson, Austin Pack, Juan Escalante


  • Top Cited Papers

    Using Generative Artificial Intelligence for Language Education Research: Insights from Using OpenAI's ChatGPT

    by Austin Pack, Jeffrey Maloney

    Progress made in Natural Language Processing (NLP) and Artificial Intelligence (AI) in recent years has resulted in these tools becoming more accessible for individuals who lack professional training. Of particular note are large language models, such as OpenAI's GPT‐3.5. Discussions of utilizing AI for language education usually focus on the impact the technology will have on students and teachers. Less frequently the center of attention is how generative AI tools can empower researchers. The purpose of this paper is to raise awareness by demonstrating and discussing examples of how OpenAI's chatbot, ChatGPT, can be leveraged as a tool for language education researchers. After briefly introducing the use of AI generative tools in the field, this paper demonstrates how a researcher, without any understanding of NLP or AI, may use ChatGPT to assist with research through multiple means, including approaches to its use for compiling and summarizing information, and as a research assistant throughout multiple steps of research. This is followed by a discussion of potential ethical concerns of using AI for research in the field. We conclude by issuing a call for further work examining how researchers can harness the potential of this technology in ethical ways.


  • TRAVELING WHILE BLACK

    by Austin Pack, Juan Escalante