What if HMDs could generate audio descriptions of real scenes for visually impaired people?
Open Access
- 30 September 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 203-212
Abstract
This paper explores the feasibility and effectiveness of using the Meta Quest 3 head-mounted display to generate real-time audio descriptions of real scenes for visually impaired individuals. The objective is to enhance the spatial awareness and interaction capabilities of visually impaired users by providing continuous, detailed audio descriptions of their surroundings. The methodology involves leveraging the Meta Quest 3 to capture real-time visual data, which is then processed and converted into audio descriptions using AI-driven software. Experiments were conducted in various real-world environments to test the accuracy and usability of the audio description system. Key findings indicate that the Meta Quest 3 can effectively deliver real-time audio descriptions with high accuracy, significantly improving the navigation and situational awareness of visually impaired users. This study demonstrates the potential of HMD technology to create more inclusive and accessible experiences, highlighting the importance of continued innovation in assistive technologies for the visually impaired.Keywords
This publication has 10 references indexed in Scilit:
- Wearable Obstacle Avoidance Electronic Travel Aids for Blind and Visually Impaired Individuals: A Systematic ReviewIEEE Access, 2023
- A Scoping Review of Assistance and Therapy with Head-Mounted Displays for People Who Are Visually ImpairedACM Transactions on Accessible Computing, 2022
- Security and Privacy Evaluation of Popular Augmented and Virtual Reality TechnologiesSSRN Electronic Journal, 2022
- Clinical applications of augmented reality in orthopaedic surgery: a comprehensive narrative reviewInternational Orthopaedics, 2022
- Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic reviewMedical Image Analysis, 2022
- Head-Mounted Display Systems as Visual Aids for the Visually Impaired:A Survey2021
- VIVR: Presence of Immersive Interaction for Visual Impairment Virtual RealityIEEE Access, 2020
- Ability of Head-Mounted Display Technology to Improve Mobility in People With Low Vision: A Systematic ReviewTranslational Vision Science & Technology, 2020
- A Multimodal Assistive System for Helping Visually Impaired in Social InteractionsInformatik Spektrum, 2017
- HOMERE: a multimodal system for visually impaired people to explore virtual environments2003