A Smart Context-Aware Hazard Attention System to Help People with Peripheral Vision Loss
Open Access
Abstract
Peripheral vision loss results in the inability to detect objects in the peripheral visual field which affects the ability to evaluate and avoid potential hazards. A different number of assistive navigation systems have been developed to help people with vision impairments using wearable and portable devices. Most of these systems are designed to search for obstacles and provide safe navigation paths for visually impaired people without any prioritisation of the degree of danger for each hazard. This paper presents a new context-aware hybrid (indoor/outdoor) hazard classification assistive technology to help people with peripheral vision loss in their navigation using computer-enabled smart glasses equipped with a wide-angle camera. Our proposed system augments users’ existing healthy vision with suitable, meaningful and smart notifications to attract the user’s attention to possible obstructions or hazards in their peripheral field of view. A deep learning object detector is implemented to recognise static and moving objects in real time. After detecting the objects, a Kalman Filter multi-object tracker is used to track these objects over time to determine the motion model. For each tracked object, its motion model represents its way of moving around the user. Motion features are extracted while the object is still in the user’s field of vision. These features are then used to quantify the danger using five predefined hazard classes using a neural network-based classifier. The classification performance is tested on both publicly available and private datasets and the system shows promising results with up to 90% True Positive Rate (TPR) associated with as low as 7% False Positive Rate (FPR), 13% False Negative Rate (FNR) and an average testing Mean Square Error (MSE) of 8.8%. The provided hazard type is then translated into a smart notification to increase the user’s cognitive perception using the healthy vision within the visual field. A participant study was conducted with a group of patients with different visual field defects to explore their feedback about the proposed system and the notification generation stage. The real-world outdoor evaluation of human subjects is planned to be performed in our near future work.Keywords
This publication has 37 references indexed in Scilit:
- ISANA: Wearable Context-Aware Indoor Assistive Navigation with Obstacle Avoidance for the Blind2016
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- Prevalence and causes of vision loss in high-income countries and in Eastern and Central Europe: 1990–2010British Journal of Ophthalmology, 2014
- Context-Aware Systems: A More Appropriate Response System to Hurricanes and Other Natural DisastersProcedia Computer Science, 2014
- Interpretation of autoperimetryJournal of Clinical Ophthalmology and Research, 2014
- Peripheral vision and pattern recognition: A reviewJournal of Vision, 2011
- Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A SurveyIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2009
- Visual field representations and locations of visual areas V1/2/3 in human visual cortexJournal of Vision, 2003
- The eccentricity effect: Target eccentricity affects performance on conjunction searchesPerception & Psychophysics, 1995
- The Hungarian method for the assignment problemNaval Research Logistics Quarterly, 1955