Exploring and Comparing Scaffolding Strategies of ChatGPT-3.5 and a Customized GPT for Reading Comprehension
Open Access
- 1 September 2025
- journal article
- Published by King Mongkut's University of Technology Thonburi in rEFLections
- Vol. 32 (3) , 1793-1819
Abstract
This study compares scaffolding strategies generated by ChatGPT-3.5 and a customized GPT in reading comprehension exercises to assist Thai university students in achieving a minimum CEFR B2 level as a requirement for Thai bachelor’s degree programs. A prompt for ChatGPT-3.5 was designed to generate four reading passages, each with five multiple-choice questions. A similar approach was used to configure a customized GPT, also with a prepared file containing four reading passages and five multiple-choice questions. Data were collected based on the responses from both versions when two incorrect and one correct answer were selected respectively for each question. The results revealed that the customized GPT generated more meaningful and diverse scaffolding strategies, whereas ChatGPT-3.5 produced consistent but limited responses focused on specific reading strategies. Furthermore, the study found that some valuable strategies, such as misconception correction and the promotion of critical thinking, were absent in ChatGPT-3.5. While both versions offer educational value, they differ in the depth and range of scaffolds provided. Educators and researchers should carefully consider these differences when integrating generative AI into instructional design. In particular, this study highlights the importance of grounding AI-assisted learning in established pedagogical theories, such as scaffolding, to support core language skills like reading comprehension. As generative AI becomes more common in classrooms, thoughtful implementation and training for both instructors and students will be key to maximizing its potential within the Thai educational context.Keywords
This publication has 31 references indexed in Scilit:
- Effects of GenAI-empowered interactive support on university EFL students' self-regulated strategy use and engagement in readingThe Internet and Higher Education, 2024
- Exploring the impact of integrating AI tools in higher education using the Zone of Proximal DevelopmentEducation and Information Technologies, 2024
- Comparative Study of GenAI (ChatGPT) vs. Human in Generating Multiple Choice Questions Based on the PIRLS Reading Assessment FrameworkProceedings of the Association for Information Science and Technology, 2024
- Students’ Holistic Reading of Socio-Scientific Texts on Climate Change in a ChatGPT ScenarioResearch in Science Education, 2024
- ChatGPT effects on cognitive skills of undergraduate students: Receiving instant responses from AI-based conversational large language models (LLMs)Computers and Education: Artificial Intelligence, 2023
- ChatGPT as a Language Learning Tool: An Emerging Technology ReportTechnology, Knowledge and Learning, 2023
- Beyond comprehension: Reading requirements in first-year undergraduate coursesJournal of English for Academic Purposes, 2022
- Scaffolding Technique2018
- A Study of the Selection of Reading Strategies among Genders by EFL College StudentsProcedia - Social and Behavioral Sciences, 2012
- Enhancing Reading Comprehension through Cognitive and Graphic Strategies: A Constructivism ApproachProcedia - Social and Behavioral Sciences, 2012