"Real Learner Data Matters" Exploring the Design of LLM-Powered Question Generation for Deaf and Hard of Hearing Learners
Preprint
Abstract
Deaf and Hard of Hearing (DHH) learners face unique challenges in learning environments, often due to a lack of tailored educational materials that address their specific needs. This study explores the potential of Large Language Models (LLMs) to generate personalized quiz questions to enhance DHH students' video-based learning experiences. We developed a prototype leveraging LLMs to generate questions with emphasis on two unique strategies: Visual Questions, which identify video segments where visual information might be misrepresented, and Emotion Questions, which highlight moments where previous DHH learners experienced learning difficulty manifested in emotional responses. Through user studies with DHH undergraduates, we evaluated the effectiveness of these LLM-generated questions in supporting the learning experience. Our findings indicate that while LLMs offer significant potential for personalized learning, challenges remain in the interaction accessibility for the diverse DHH community. The study highlights the importance of considering language diversity and culture in LLM-based educational technology design.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Inclusive Deaf Education Enabled by Artificial Intelligence: The Path to a SolutionInternational Journal of Artificial Intelligence in Education, 2024
- ChatGPT for good? On opportunities and challenges of large language models for educationLearning and Individual Differences, 2023
- Synergistic integration between internet of things and augmented reality technologies for deaf persons in e-learning platformThe Journal of Supercomputing, 2022
- Exploring collaborative caption editing to augment video-based learningEducational Technology Research and Development, 2022
- A Systematic Review of Automatic Question Generation for Educational PurposesInternational Journal of Artificial Intelligence in Education, 2019
- Digital Video Based Rampak Kendang Learning Media for Deaf StudentsJournal of Physics: Conference Series, 2019
- Consistently inconsistent: An examination of the variability in the identification of emotional disturbancePsychology in the Schools, 2018
- The benefits of embedded question adjuncts for low and high structure builders.Journal of Educational Psychology, 2007
- Measurement of negative attitudes toward robots2006
- The role of video technology in on-line lectures for the deafDisability and Rehabilitation, 2004