VeasyGuide: Personalized Visual Guidance for Low-vision Learners on Instructor Actions in Presentation Videos
Authors:
- Yotam SechaykYSYotam Sechayk
- Ariel ShamirASAriel Shamir
- Amy PavelAPAmy Pavel
- Takeo IgarashiTITakeo Igarashi
Preprint
Abstract
Instructors often rely on visual actions such as pointing, marking, and sketching to convey information in educational presentation videos. These subtle visual cues often lack verbal descriptions, forcing low-vision (LV) learners to search for visual indicators or rely solely on audio, which can lead to missed information and increased cognitive load. To address this challenge, we conducted a co-design study with three LV participants and developed VeasyGuide, a tool that uses motion detection to identify instructor actions and dynamically highlight and magnify them. VeasyGuide produces familiar visual highlights that convey spatial context and adapt to diverse learners and content through extensive personalization and real-time visual feedback. VeasyGuide reduces visual search effort by clarifying what to look for and where to look. In an evaluation with 8 LV participants, learners demonstrated a significant improvement in detecting instructor actions, with faster response times and significantly reduced cognitive load. A separate evaluation with 8 sighted participants showed that VeasyGuide also enhanced engagement and attentiveness, suggesting its potential as a universally beneficial tool.Keywords
All Related Versions
- Version 1, 2025-07-29, ArXiv
- Version 2, 2025-08-05, ArXiv
- Published version: , 1.
This publication has 30 references indexed in Scilit:
- A Closer Look into Recent Video-based Learning Research: A Comprehensive Review of Video Characteristics, Tools, Technologies, and Learning EffectivenessInternational Journal of Artificial Intelligence in Education, 2025
- The Effectiveness of Visual and Audio Wayfinding Guidance on Smartglasses for People with Low Vision2020
- Reflecting on reflexive thematic analysisQualitative Research in Sport, Exercise and Health, 2018
- SteeringWheel2018
- User-centred design with visually impaired pupils: A case study of a game editor for orientation and mobility trainingInternational Journal of Child-Computer Interaction, 2017
- CueSee2016
- The Self-Reference Effect on Memory in Early ChildhoodChild Development, 2014
- A concept map-embedded educational computer game for improving students' learning performance in natural science coursesComputers & Education, 2013
- What Is Low Vision? A Re-evaluation of DefinitionsOptometry and Vision Science, 1999
- Visual pattern recognition by moment invariantsIRE Transactions on Information Theory, 1962