Deep Learning Approaches for Continuous Sign Language Recognition: A Comprehensive Review
Top Cited Papers
Open Access
- 25 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 55524-55544
Abstract
Sign language utilizing hand gestures for visual mode of communication, body actions, and facial expressions. Due to the increasing incidence of hearing deficiencies, the field of Continuous Sign Language Recognition (CSLR) has seen a considerable increase in research, which involves identifying consecutive signs in video streams without previous information of their sequential limitations. This survey reviews CSLR research, presenting deep knowledge into the development of CSLR systems. It critically analyzes numerous studies, organizing them into a comprehensive taxonomy covering aspects such as sign language, data collection, input method, gesture signals, identification methods, applied data collections, and comprehensive efficiency. The article further categorizes deep-learning CSLR models according to spatial, temporal, and alignment approaches, highlighting their benefits and drawbacks. Furthermore, it explores various research aspects, such as the challenges of CSLR, the significance of nonverbal elements in CSLR systems, and the gaps in the body of current research. This classification serves as a helpful tool for researchers developing and organizing cutting-edge CSLR methods. The study highlights the effectiveness of deep learning systems capture different sign language signals. On the other hand, several challenges remain, such as the need for diverse, naturalistic datasets, improved signer diversity, and realtime CSLR systems. Addressing these gaps will be essential for advancing CSLR’s real-world applications and developing more robust, efficient models for the future. The conclusions give a wider Comprehension of sign language recognition and set the groundwork for future studies focused on addressing the current challenges and issues in this developing area.Keywords
Funding Information
- National Research Foundation of Korea (RS-2022-NR-069955, 2022R1A2C1092178)
- Basic Science Research Program through NRF funded by the Ministry of Education (2020R1A6A1A03038540)
- Institute of Information Communications Technology Planning Evaluation (IITP) through the Metaverse Support Program to Nurture the Best Talents Grant funded by the Korea Government (IITP-2024-RS-2023-00254529)
This publication has 158 references indexed in Scilit:
- BSL-1K: Scaling Up Co-articulated Sign Language Recognition Using Mouthing Cues2020
- Stochastic Fine-Grained Labeling of Multi-state Sign Glosses for Continuous Sign Language Recognition2020
- Novel Feature Extraction and Classification Technique for Sensor-Based Continuous Arabic Sign Language Recognition2015
- Hand Tracking and Affine Shape-Appearance Handshape Sub-units in Continuous Sign Language Recognition2012
- Enhancing a Sign Language Translation System with Vision-Based Features2009
- Multimodal Continuous Recognition System for Greek Sign Language Using Various Grammars2006
- Signer-Independent Continuous Sign Language Recognition Based on SRN/HMM2002
- Towards an Automatic Sign Language Recognition System Using Subunits2002
- A Real-Time Large Vocabulary Continuous Recognition System for Chinese Sign Language2001
- A Framework for Recognizing the Simultaneous Aspects of American Sign LanguageComputer Vision and Image Understanding, 2001