Evaluating Gaze Interactions within AR for Nonspeaking Autistic Users
Open Access
- 9 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Abstract
Nonspeaking autistic individuals often face significant inclusion barriers in various aspects of life, mainly due to a lack of effective communication means. Specialized computer software, particularly delivered via Augmented Reality (AR), offers a promising and accessible way to improve their ability to engage with the world. While research has explored near-hand interactions within AR for this population, gaze-based interactions remain unexamined. Given the fine motor skill requirements and potential for fatigue associated with near-hand interactions, there is a pressing need to investigate the potential of gaze interactions as a more accessible option. This paper presents a study investigating the feasibility of eye gaze interactions within an AR environment for nonspeaking autistic individuals. We utilized the HoloLens 2 to create an eye gaze-based interactive system, enabling users to select targets either by fixating their gaze for a fixed period or by gazing at a target and triggering selection with a physical button (referred to as a ‘clicker’). We developed a system called HoloGaze that allows a caregiver to join an AR session to train an autistic individual in gaze-based interactions as appropriate. Using HoloGaze, we conducted a study involving 14 nonspeaking autistic participants. The study had several phases, including tolerance testing, calibration, gaze training, and interacting with a complex interface: a virtual letterboard. All but one participant were able to wear the device and complete the system’s default eye calibration; 10 participants completed all training phases that required them to select targets using gaze only or gaze-click. Interestingly, the 7 users who chose to continue to the testing phase with gaze-click were much more successful than those who chose to continue with gaze alone. We also report on challenges and improvements needed for future gaze-based interactive AR systems for this population. Our findings pave the way for new opportunities for specialized AR solutions tailored to the needs of this under-served and under-researched population.Keywords
Funding Information
- Alberta Innovates
- SSHRC
- University of Calgary
- NSERC
This publication has 26 references indexed in Scilit:
- Evaluating the Acceptability and Usability of a Head-Mounted Augmented Reality Approach for Autistic Children with High Support Needs2022
- Performance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality2019
- Coming to My SensesAutism in Adulthood, 2019
- Dispelling the Gorilla Arm Syndrome: The Viability of Prolonged Gesture Interactions2017
- Communication growth in minimally verbal children with ASD: The importance of interactionAutism Research, 2016
- The Introduction of Keyboarding to Children With Autism Spectrum Disorders With Handwriting Difficulties: A Help or a Hindrance?Australasian Journal of Special Education, 2012
- Patterns of Visual Attention to Faces and Objects in Autism Spectrum DisorderJournal of Autism and Developmental Disorders, 2010
- Motor Coordination in Autism Spectrum Disorders: A Synthesis and Meta-AnalysisJournal of Autism and Developmental Disorders, 2010
- The effect of context priming and task type on augmentative communication performanceAugmentative and Alternative Communication, 2009
- The Picture Exchange Communication SystemPerspectives on Language Learning and Education, 2002