Wesley Morris
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Wesley Morris has a total of 38 co-authors. Here are the top co-authors by number of shared publications:
- Scott Andrew Crossley
Vanderbilt University, Nashville, USA
9 shared publications - Langdon Holmes
Vanderbilt University
8 shared publications - Joon Suh Choi
Vanderbilt University
3 shared publications - Alex Endert
Georgia Institute of Technology, Atlanta, Georgia, USA
2 shared publications Langdon Holmes
Vanderbilt University, Nashville, USA
2 shared publicationsScott Crossley
Vanderbilt University, Nashville, USA
2 shared publications
Latest Publications
- Open Access
- 13 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 2474-2496
Guidelines for Designing AI Technologies to Support Adult Learning
- 13 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 2474-2496
Open AccessGuidelines for Designing AI Technologies to Support Adult Learning
- Open Access
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 876-882
The Effects of AI Feedback on College Students’ Reading and Writing Performance in an Intelligent Text Framework
This study investigates how AI feedback influences college students’ reading and writing performance within an intelligent text aligned with the Interactive Constructive Active and Passive (ICAP) framework. Using a within-subjects design, students completed two read-to-write tasks — constructed response items (CRIs) and summaries — under two conditions: (1) Strategic Thinking And Interactive Reading Support (STAIRS), which provided AI feedback to support interactive engagement, and (2) Random Reread, a control condition without AI feedback to support constructive engagement. STAIRS offered automated scoring of read-to-write tasks, targeted rereading, and a chatbot that engaged students in interactive dialogues to support revision. Results showed that STAIRS significantly improved students’ summary revisions and subsequent summary performance, suggesting that AI feedback functions not only as guidance for improving current summaries but also benefits future performance. However, students in the STAIRS condition did not show higher CRI or summative quiz scores. CRI scores may have been limited by a ceiling effect, while the lack of quiz benefits may reflect a tradeoff in the study design, where the classroom tasks did not fully match the system’s activities. These mixed outcomes highlight the need to further explore how AI feedback may support different aspects of reading with an intelligent text.
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 876-882
Open AccessThe Effects of AI Feedback on College Students’ Reading and Writing Performance in an Intelligent Text Framework
This study investigates how AI feedback influences college students’ reading and writing performance within an intelligent text aligned with the Interactive Constructive Active and Passive (ICAP) framework. Using a within-subjects design, students completed two read-to-write tasks — constructed response items (CRIs) and summaries — under two conditions: (1) Strategic Thinking And Interactive Reading Support (STAIRS), which provided AI feedback to support interactive engagement, and (2) Random Reread, a control condition without AI feedback to support constructive engagement. STAIRS offered automated scoring of read-to-write tasks, targeted rereading, and a chatbot that engaged students in interactive dialogues to support revision. Results showed that STAIRS significantly improved students’ summary revisions and subsequent summary performance, suggesting that AI feedback functions not only as guidance for improving current summaries but also benefits future performance. However, students in the STAIRS condition did not show higher CRI or summative quiz scores. CRI scores may have been limited by a ceiling effect, while the lack of quiz benefits may reflect a tradeoff in the study design, where the classroom tasks did not fully match the system’s activities. These mixed outcomes highlight the need to further explore how AI feedback may support different aspects of reading with an intelligent text.
- Open Access
LLM Prompt Evaluation for Educational Applications
As large language models (LLMs) become increasingly common in educational applications, there is a growing need for evidence-based methods to design and evaluate LLM prompts that produce personalized and pedagogically aligned out-puts. This study presents a generalizable, systematic approach for evaluating prompts, demonstrated through an analysis of LLM-generated follow-up questions in a structured dialogue activity. Six prompt templates were designed and tested. The templates incorporated established prompt engineering patterns, with each prompt emphasizing distinct pedagogical strategies. The prompt templates were compared through a tournament-style evaluation framework that can be adapted for other educational applications. The tournament employed the Glicko2 rating system with eight judges evaluating question pairs across three dimensions: format, dialogue support, and appropriateness for learners. Data was sourced from 120 authentic user interactions across three distinct educational deployments. Results showed that a single prompt related to strategic reading out-performed other templates with win probabilities ranging from 81% to 100% in pairwise comparisons. This prompt combined persona and context manager pat-terns and was designed to support metacognitive learning strategies such as self-directed learning. The methodology showcases how educational technology re- searchers can systematically evaluate and improve prompt designs, moving beyond ad-hoc prompt engineering toward evidence-based prompt development for educational applications.
Open AccessLLM Prompt Evaluation for Educational Applications
As large language models (LLMs) become increasingly common in educational applications, there is a growing need for evidence-based methods to design and evaluate LLM prompts that produce personalized and pedagogically aligned out-puts. This study presents a generalizable, systematic approach for evaluating prompts, demonstrated through an analysis of LLM-generated follow-up questions in a structured dialogue activity. Six prompt templates were designed and tested. The templates incorporated established prompt engineering patterns, with each prompt emphasizing distinct pedagogical strategies. The prompt templates were compared through a tournament-style evaluation framework that can be adapted for other educational applications. The tournament employed the Glicko2 rating system with eight judges evaluating question pairs across three dimensions: format, dialogue support, and appropriateness for learners. Data was sourced from 120 authentic user interactions across three distinct educational deployments. Results showed that a single prompt related to strategic reading out-performed other templates with win probabilities ranging from 81% to 100% in pairwise comparisons. This prompt combined persona and context manager pat-terns and was designed to support metacognitive learning strategies such as self-directed learning. The methodology showcases how educational technology re- searchers can systematically evaluate and improve prompt designs, moving beyond ad-hoc prompt engineering toward evidence-based prompt development for educational applications.
- 20 July 2025
- Published by Springer Nature
- p. 227-234
Uncovering Differential Sensitivity Toward Linguistic Features of Cohesion in Large Language Models
- 20 July 2025
- Published by Springer Nature
- p. 227-234
Uncovering Differential Sensitivity Toward Linguistic Features of Cohesion in Large Language Models
- Open Access
- 17 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 2-12
Exploratory Assessment of Learning in an Intelligent Text Framework: iTELL RCT
- 17 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 2-12
Open AccessExploratory Assessment of Learning in an Intelligent Text Framework: iTELL RCT
- Top Cited PapersOpen Access
- 18 July 2024
- Published by Elsevier in International Journal of Artificial Intelligence in Education
- Vol. 35 (2) , 559-586
Automated Scoring of Constructed Response Items in Math Assessment Using Large Language Models
- 18 July 2024
- Published by Elsevier in International Journal of Artificial Intelligence in Education
- Vol. 35 (2) , 559-586
Top Cited PapersOpen AccessAutomated Scoring of Constructed Response Items in Math Assessment Using Large Language Models
- Top Cited PapersOpen Access
- 28 March 2024
- Published by Elsevier in International Journal of Artificial Intelligence in Education
- Vol. 35 (3) , 1022-1043
Formative Feedback on Student-Authored Summaries in Intelligent Textbooks Using Large Language Models
- 28 March 2024
- Published by Elsevier in International Journal of Artificial Intelligence in Education
- Vol. 35 (3) , 1022-1043
Top Cited PapersOpen AccessFormative Feedback on Student-Authored Summaries in Intelligent Textbooks Using Large Language Models
- Open Access
- 18 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 787-802
iScore: Visual Analytics for Interpreting How Language Models Automatically Score Summaries
The recent explosion in popularity of large language models (LLMs) has inspired learning engineers to incorporate them into adaptive educational tools that automatically score summary writing. Understanding and evaluating LLMs is vital before deploying them in critical learning environments, yet their unprecedented size and expanding number of parameters inhibits transparency and impedes trust when they underperform. Through a collaborative user-centered design process with several learning engineers building and deploying summary scoring LLMs, we characterized fundamental design challenges and goals around interpreting their models, including aggregating large text inputs, tracking score provenance, and scaling LLM interpretability methods. To address their concerns, we developed iScore, an interactive visual analytics tool for learning engineers to upload, score, and compare multiple summaries simultaneously. Tightly integrated views allow users to iteratively revise the language in summaries, track changes in the resulting LLM scores, and visualize model weights at multiple levels of abstraction. To validate our approach, we deployed iScore with three learning engineers over the course of a month. We present a case study where interacting with iScore led a learning engineer to improve their LLM’s score accuracy by three percentage points. Finally, we conducted qualitative interviews with the learning engineers that revealed how iScore enabled them to understand, evaluate, and build trust in their LLMs during deployment.
- 18 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 787-802
Open AccessiScore: Visual Analytics for Interpreting How Language Models Automatically Score Summaries
The recent explosion in popularity of large language models (LLMs) has inspired learning engineers to incorporate them into adaptive educational tools that automatically score summary writing. Understanding and evaluating LLMs is vital before deploying them in critical learning environments, yet their unprecedented size and expanding number of parameters inhibits transparency and impedes trust when they underperform. Through a collaborative user-centered design process with several learning engineers building and deploying summary scoring LLMs, we characterized fundamental design challenges and goals around interpreting their models, including aggregating large text inputs, tracking score provenance, and scaling LLM interpretability methods. To address their concerns, we developed iScore, an interactive visual analytics tool for learning engineers to upload, score, and compare multiple summaries simultaneously. Tightly integrated views allow users to iteratively revise the language in summaries, track changes in the resulting LLM scores, and visualize model weights at multiple levels of abstraction. To validate our approach, we deployed iScore with three learning engineers over the course of a month. We present a case study where interacting with iScore led a learning engineer to improve their LLM’s score accuracy by three percentage points. Finally, we conducted qualitative interviews with the learning engineers that revealed how iScore enabled them to understand, evaluate, and build trust in their LLMs during deployment.
- 30 June 2023
- Published by Springer Nature
- p. 484-489
Using Large Language Models to Provide Formative Feedback in Intelligent Textbooks
- 30 June 2023
- Published by Springer Nature
- p. 484-489
Using Large Language Models to Provide Formative Feedback in Intelligent Textbooks
- 30 June 2023
- Published by Springer Nature
- p. 708-713
Deidentifying Student Writing with Rules and Transformers
- 30 June 2023
- Published by Springer Nature
- p. 708-713
Deidentifying Student Writing with Rules and Transformers