Deep Transfer Learning for Sign Language Image Classification: A Bisindo Dataset Study
Open Access
- 30 September 2023
- journal article
- research article
- Published by Universitas Bina Nusantara in Engineering, MAthematics and Computer Science Journal (EMACS)
- Vol. 5 (3) , 175-180
Abstract
This study aims to identify and categorize the BISINDO sign language dataset, primarily consisting of image data. Deep learning techniques are used, with three pre-trained models: ResNet50 for training, MobileNetV4 for validation, and InceptionV3 for testing. The primary objective is to evaluate and compare the performance of each model based on the loss function derived during training. The training success rate provides a rough idea of the ResNet50 model's understanding of the BISINDO dataset, while MobileNetV4 measures validation loss to understand the model's generalization abilities. The InceptionV3-evaluated test loss serves as the ultimate litmus test for the model's performance, evaluating its ability to classify unobserved sign language images. The results of these exhaustive experiments will determine the most effective model and achieve the highest performance in sign language recognition using the BISINDO dataset.Keywords
This publication has 13 references indexed in Scilit:
- An Approach for Sign Language Recognition with Deep Learning Algorithm2023
- Transfer Learning Technique with EfficientNet for Facial Expression Recognition SystemRevue d'intelligence artificielle, 2022
- Model Penerjemah Bahasa Isyarat Indonesia (BISINDO) Menggunakan Pendekatan Transfer LearningPETIR, 2021
- Classification of American Sign Language by Applying a Transfer Learned Deep Convolutional Neural Network2021
- The Development of Android for Indonesian Sign Language Using Tensorflow Lite and CNN: An Initial StudyJournal of Physics: Conference Series, 2021
- Deep learning-based sign language recognition system for static signsNeural Computing and Applications, 2020
- Indonesian Sign Language Recognition Based on Shape of Hand GestureProcedia Computer Science, 2019
- Gesture recognition for Indonesian Sign Language (BISINDO)Journal of Physics: Conference Series, 2018
- Hand gesture recognition based on convolution neural networkCluster Computing, 2017
- RESPON TUNARUNGU TERHADAP PENGGUNAAN SISTEM BAHASA ISYARAT INDONESA (SIBI) DAN BAHASA ISYARAT INDONESIA (BISINDO) DALAM KOMUNIKASIINKLUSI, 2015