Towards Enhancing Blind Users' Interaction Experience with Online Videos via Motion Gestures
Authors:
Open Access
- 25 August 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- Vol. 2021, 231-236
Abstract
Blind users interact with smartphone applications using a screen reader, an assistive technology that enables them to navigate and listen to application content using touch gestures. Since blind users rely on screen reader audio, interacting with online videos can be challenging due to the screen reader audio interfering with the video sounds. Existing solutions to address this interference problem are predominantly designed for desktop scenarios, where special keyboard or mouse actions are supported to facilitate 'silent' and direct access to various video controls such as play, pause, and progress bar. As these solutions are not transferable to smartphones, suitable alternatives are desired. In this regard, we explore the potential of motion gestures in smartphones as an effective and convenient method for blind screen reader users to interact with online videos. Specifically, we designed and developed YouTilt, an Android application that enables screen reader users to exploit an assortment of motion gestures to access and manipulate various video controls. We then conducted a user study with 10 blind participants to investigate whether blind users can leverage YouTilt to properly execute motion gestures for video-interaction tasks while simultaneously listening to video sounds. Analysis of the study data showed a significant improvement in usability by as much as 43.3% (avg.) with YouTilt compared to that with default screen reader, and overall a positive attitude and acceptance towards motion gesture-based video interaction.Keywords
This publication has 12 references indexed in Scilit:
- Designing motion marking menus for people with visual impairmentsInternational Journal of Human-Computer Studies, 2018
- Investigating Tilt-based Gesture Keyboard Entry for Single-Handed Text Entry on Large Devices2017
- Designing Motion Gesture Interfaces in Mobile Phones for Blind PeopleJournal of Computer Science and Technology, 2014
- Web Videos – Concerns About Accessibility based on User Centered DesignProcedia Computer Science, 2014
- User-defined motion gestures for mobile interaction2011
- Making multimedia content accessible for screen reader users2007
- Tilt-Based Automatic Zooming and Scaling in Mobile Devices – A State-Space Implementation2004
- TiltText2003
- Rock 'n' Scroll is here to stay [user interface]IEEE Computer Graphics and Applications, 2000
- Tilting operations for small screen interfaces1996