The Eye: A Light Weight Mobile Application for Visually Challenged People Using Improved YOLOv5l Algorithm
Open Access
- 1 October 2023
- journal article
- research article
- Published by Ital Publication in Emerging Science Journal
- Vol. 7 (5) , 1636-1652
Abstract
The eye is an essential sensory organ that allows us to perceive our surroundings at a glance. Losing this sense can result in numerous challenges in daily life. However, society is designed for the majority, which can create even more difficulties for visually impaired individuals. Therefore, empowering them and promoting self-reliance are crucial. To address this need, we propose a new Android application called “The Eye” that utilizes Machine Learning (ML)-based object detection techniques to recognize objects in real-time using a smartphone camera or a camera attached to a stick. The article proposed an improved YOLOv5l algorithm to improve object detection in visual applications. YOLOv5l has a larger model size and captures more complex features and details, leading to enhanced object detection accuracy compared to smaller variants like YOLOv5s and YOLOv5m. The primary enhancement in the improved YOLOv5l algorithm is integrating L1 and L2 regularization techniques. These techniques prevent overfitting and improve generalization by adding a regularization term to the loss function during training. Our approach combines image processing and text-to-speech conversion modules to produce reliable results. The Android text-to-speech module is then used to convert the object recognition results into an audio output. According to the experimental results, the improved YOLOv5l has higher detection accuracy than the original YOLOv5 and can detect small, multiple, and overlapped targets with higher accuracy. This study contributes to the advancement of technology to help visually impaired individuals become more self-sufficient and confident. Doi: 10.28991/ESJ-2023-07-05-011 Full Text: PDFKeywords
This publication has 28 references indexed in Scilit:
- A vision system to assist visually challenged people for face recognition using multi-task cascaded convolutional neural network (MTCNN) and local binary pattern (LBP)Journal of Ambient Intelligence and Humanized Computing, 2023
- Design and implementation of a walking stick aid for visually challenged peopleAIP Conference Proceedings, 2023
- Deep learning based assistive technology on audio visual speech recognition for hearing impairedInternational Journal of Cognitive Computing in Engineering, 2022
- Smart hearing and visually impaired passenger voice alert systemAIP Conference Proceedings, 2021
- Melanoma Lesion Detection and Segmentation Using YOLOv4-DarkNet and Active ContourIEEE Access, 2020
- Using channel pruning-based YOLO v4 deep learning algorithm for the real-time and accurate detection of apple flowers in natural environmentsComputers and Electronics in Agriculture, 2020
- A Deep Learning-Based Hybrid Framework for Object Detection and Recognition in Autonomous DrivingIEEE Access, 2020
- Real-Time Environment Description Application for Visually Challenged People2020
- Android-Based Blind Learning Application2019
- Mini-YOLOv3: Real-Time Object Detector for Embedded ApplicationsIEEE Access, 2019