Greek Sign Language Detection with Artificial Intelligence
Open Access
- 15 August 2025
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 14 (16) , 3241
Abstract
Sign language serves as a vital way to communicate with individuals with hearing loss, deafness, or a speech disorder, yet accessibility remains limited, requiring technological advances to bridge the gap. This study presents the first real-time Greek Sign Language recognition system utilizing deep learning and embedded computers. The recognition system is implemented using You Only Look Once (YOLO11X-seg), an advanced object detection model, which is embedded in a Python-based framework. The model is trained to recognize Greek Sign Language letters and an expandable set of specific words, i.e., the model is capable of distinguishing between static hand shapes (letters) and dynamic gestures (words). The most important advantage of the proposed system is its mobility and scalable processing power. The data are recorded using a mobile IP camera (based on Raspberry Pi 4) via a Motion-Joint Photographic Experts Group (MJPEG) Stream. The image is transmitted over a private ZeroTier network to a remote powerful computer capable of quickly processing large sign language models, employing Moonlight streaming technology. Smaller models can run on an embedded computer. The experimental evaluation shows excellent 99.07% recognition accuracy, while real-time operation is supported, with the image frames processed in 42.7 ms (23.4 frames/s), offering remote accessibility without requiring a direct connection to the processing unit.Keywords
This publication has 32 references indexed in Scilit:
- Siformer: Feature-isolated Transformer for Efficient Skeleton-based Sign Language Recognition2024
- Sign Language Interpreting System Using Recursive Neural NetworksApplied Sciences, 2024
- LSTM-Based Recognition of Sign Language2024
- Continuous Sign Language Recognition System Using Deep Learning with MediaPipe HolisticWireless Personal Communications, 2024
- Promoting Sign Language Awareness: A Deep Learning Web Application for Sign Language Recognition2024
- Using Convolutional Neural Networks for Visual Sign Language Recognition2024
- A Comprehensive Application for Sign Language Alphabet and World Recognition, Text-to-Action Conversion for Learners, Multi-Language Support and Integrated Voice Output Functionality2024
- A Performance Comparison of Japanese Sign Language Recognition with ViT and CNN Using Angular FeaturesApplied Sciences, 2024
- Progression Learning Convolution Neural Model-Based Sign Language Recognition Using Wearable Glove DevicesComputation, 2024
- Sign Language Translation Across Multiple Languages2024