Accessible Point-and-Tap Interaction for Acquiring Detailed Information About Tactile Graphics and 3D Models
- 5 July 2024
- book chapter
- Published by Springer Nature
- Vol. 14750, 252-259
Abstract
We have devised a novel “Point-and-Tap” interface that enables people who are blind or visually impaired (BVI) to easily acquire multiple levels of information about tactile graphics and 3D models. The interface uses an iPhone’s depth and color cameras to track the user’s hands while they interact with a model. When the user points to a feature of interest on the model with their index finger, the system reads aloud basic information about that feature. For additional information, the user lifts their index finger and taps the feature again. This process can be repeated multiple times to access additional levels of information. For instance, tapping once on a region in a tactile map could trigger the name of the region, with subsequent taps eliciting the population, area, climate, etc. No audio labels are triggered unless the user makes a pointing gesture, which allows the user to explore the model freely with one or both hands. Multiple taps can be used to skip through information levels quickly, with each tap interrupting the current utterance. This allows users to reach the desired level of information more quickly than listening to all levels in sequence. Experiments with six BVI participants demonstrate that the approach is practical, easy to learn and effective.Keywords
This publication has 10 references indexed in Scilit:
- TouchPilot: Designing a Guidance System that Assists Blind People in Learning Complex 3D Structures2023
- Tactile Audio Responsive Intelligent SystemIEEE Access, 2022
- Non-visual Access to an Interactive 3D Map2022
- Markit and Talkit2017
- A Survey on the Use of Mobile Applications for People who Are Visually ImpairedJournal of Visual Impairment & Blindness, 2017
- The Tactile Graphics Helper2015
- Interactivity Improves Usability of Geographic Maps for Visually Impaired PeopleHuman–Computer Interaction, 2014
- Can Braille Be Revived? A Possible Impact of High-End Braille and Mainstream Technology on the Revival of Tactile Literacy MediumAssistive Technology, 2014
- Straight from the Source: Perceptions of Students with Visual Impairments about Graphic UseJournal of Visual Impairment & Blindness, 2014
- CamIO2013