An Audio Augmented Reality Navigation System for Blind and Visually Impaired People Integrating BIM and Computer Vision
Open Access
- 9 September 2025
- Vol. 15 (18) , 3252
Abstract
Since statistics show a growing trend in blindness and visual impairment, the development of navigation systems supporting Blind and Visually Impaired People (BVIP) must be urgently addressed. Guiding BVIP to a desired destination across indoor and outdoor settings without relying on a pre-installed infrastructure is an open challenge. While numerous solutions have been proposed by researchers in recent decades, a comprehensive navigation system that can support BVIP mobility in mixed and unprepared environments is still missing. This study proposes a novel navigation system that enables BVIP to request directions and be guided to a desired destination across heterogeneous and unprepared settings. To achieve this, the system applies Computer Vision (CV)—namely an integrated Structure from Motion (SfM) pipeline—for tracking the user and exploits Building Information Modelling (BIM) semantics for planning the reference path to reach the destination. Audio Augmented Reality (AAR) technology is adopted for directional guidance delivery due to its intuitive and non-intrusive nature, which allows seamless integration with traditional mobility aids (e.g., white canes or guide dogs). The developed system was tested on a university campus to assess its performance during both path planning and navigation tasks, the latter involving users in both blindfolded and sighted conditions. Quantitative results indicate that the system computed paths in about 10 milliseconds and effectively guided blindfolded users to their destination, achieving performance comparable to that of sighted users. Remarkably, users in blindfolded conditions completed navigation tests with an average deviation from the reference path within the 0.60-meter shoulder width threshold in 100% of the trials, compared to 75% of the tests conducted by sighted users. These findings demonstrate the system’s accuracy in maintaining navigational alignment within acceptable human spatial tolerances. The proposed approach contributes to the advancement of BVIP assistive technologies by enabling scalable, infrastructure-free navigation across heterogeneous environments.Keywords
Funding Information
- National Recovery and Resilience Plan (NRRP) (ECS00000041, CUP I33C22001330007, 0001057.23-06-2022)
- European Union—NextGenerationEU (ECS00000041, CUP I33C22001330007, 0001057.23-06-2022)
This publication has 31 references indexed in Scilit:
- A comprehensive review of navigation systems for visually impaired individualsHeliyon, 2024
- Recent advancements in indoor electronic travel aids for the blind or visually impaired: a comprehensive review of technologies and implementationsUniversal Access in the Information Society, 2024
- A review of path following control strategies for autonomous robotic vehicles: Theory, simulations, and experimentsJournal of Field Robotics, 2022
- Assistive Devices Analysis for Visually Impaired Persons: A Review on TaxonomyIEEE Access, 2022
- A comparative analysis of trajectory similarity measuresGIScience & Remote Sensing, 2021
- Route planning methods in indoor navigation tools for vision impaired persons: a systematic reviewDisability and Rehabilitation: Assistive Technology, 2021
- Tools and Technologies for Blind and Visually Impaired Navigation Support: A ReviewIETE Technical Review, 2020
- An Indoor and Outdoor Navigation System for Visually Impaired PeopleIEEE Access, 2019
- Virtual-Blind-Road Following-Based Wearable Navigation Device for Blind PeopleIEEE Transactions on Consumer Electronics, 2018
- RGB-D camera based wearable navigation system for the visually impairedComputer Vision and Image Understanding, 2016