Computer Vision-Based Bengali Sign Language To Text Generation
Authors:
- 5 December 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. Five, 1-6
Abstract
In the whole world, around 7% of people have hearing and speech impairment problems. They use sign language as their communication method. As for our country, there are lots of people born with hearing and speech impairment problems. Therefore, our primary focus is to work for those people by converting Bangla sign language into text. There are already various projects on Bangla sign language done by other people. However, they focused more on the separate alphabets and numerical numbers. That is why, we want to concentrate on Bangla word signs since communication is done using words or phrases rather than alphabets. There is no proper database for Bangla word sign language, so we want to make a database for our work using BDSL. In recognition of sign language (SLR), there usually are two types of scenarios: isolated SLR, which takes words by word and completes recognize action, and the other one is continuous SLR, which completes action by translating the whole sentence at once. We are working on isolated SLR. We introduce a method where we are going to use PyTorch and YOLOv5 for a video classification model to convert Bangla sign language into the text from the video where each video has only one sign language word. Here, we have achieved an accuracy rate of 76.29% on the training dataset and 51.44% on the testing dataset. We are working to build a system that will make it easier for hearing and speech-disabled people to interact with the general public.Keywords
This publication has 8 references indexed in Scilit:
- Sign Language Translator Using YOLO Algorithm2021
- Indonesian Sign Language Recognition using YOLO MethodIOP Conference Series: Materials Science and Engineering, 2021
- Real-Time Bangla Sign Language Detection with Sentence and Speech Generation2020
- Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison2020
- A Real Time Malaysian Sign Language Detection Algorithm Based on YOLOv3International Journal of Recent Technology and Engineering (IJRTE), 2019
- Bangla Sign Language Conversation Interpreter Using Image Processing2019
- Video-Based Sign Language Recognition Without Temporal SegmentationProceedings of the AAAI Conference on Artificial Intelligence, 2018
- NEURAL NETWORK CLASSIFIER FOR CONTINUOUS SIGN LANGUAGE RECOGNITION WITH SELFIE VIDEOFar East Journal of Electronics and Communications, 2017