Enhanced Obstacle Detection Using Bilateral Vision-Aided Transformer Neural Network for Visually Impaired Persons
Preprint
- 12 June 2025
- preprint
- Published by Springer Nature in Research Square
Abstract
Obstacle detection remains vital in autonomous navigation and assistive technologies, especially for visually impaired individuals. This work introduces an enhanced obstacle detection framework based on a Bilateral Vision Transformer and Convolution Kernel Neural Network (BViT-CKNN). The system incorporates stereo vision data and applies a bilateral filter to reduce noise while preserving edge details. A Vision Transformer (ViT) model is then used for global feature extraction, and a Convolution Kernel Neural Network (CKNN) captures fine-grained local features. Evaluated using the COCO dataset, the proposed BViT-CKNN achieves superior performance in precision (0.93), recall (0.91), F1-score (0.92), and Mean Absolute Error (MAE) reduction (3.16%) compared to existing methods.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- A fine-grained recognition technique for identifying Chinese food imagesHeliyon, 2023
- An effective obstacle detection system using deep learning advantages to aid blind and visually impaired navigationAin Shams Engineering Journal, 2023
- Empowering and conquering infirmity of visually impaired using AI‐technology equipped with object detection and real‐time voice feedback system in healthcare applicationCAAI Transactions on Intelligence Technology, 2023
- Deep learning based object detection and surrounding environment description for visually impaired peopleHeliyon, 2023
- Outdoor mobility aid for people with visual impairment: Obstacle detection and responsive framework for the scene perception during the outdoor mobility of people with visual impairmentExpert Systems with Applications, 2023
- Artificial intelligence for visually impairedDisplays, 2023
- Image local structure information learning for fine-grained visual classificationScientific Reports, 2022
- Obstacle‐transformer: A trajectory prediction network based on surrounding trajectoriesIET Cyber-Systems and Robotics, 2022
- AviPer: assisting visually impaired people to perceive the world with visual-tactile multimodal attention networkCCF Transactions on Pervasive Computing and Interaction, 2022
- Smart Assistive System for Visually Impaired People Obstruction Avoidance Through Object Detection and ClassificationIEEE Access, 2022