An AI-driven, wearable, conformal ring system for real-time and user-independent sign language interpretation
Open Access
- 1 May 2026
- journal article
- research article
- Published by American Association for the Advancement of Science (AAAS) in Science Advances
- Vol. 12 (18) , eaec8995
Abstract
Sign language translation systems have long aimed to bridge the communication between signers and nonsigners. However, preliminary systems rely on glove-type wearables or wired sensor arrays, which constrain hand movement, reduce comfort, and require nonpersonalized sensor positions that limit adaptability across users. Here, we introduce a wirelessly connected, ring-type sign language translator (WRSLT) designed to overcome these limitations by enabling full finger mobility through independent sensor rings and multilink communication. The system supports static and dynamic gesture detection using selected fingers via quantitative relevance analysis and achieves robust user-independent performance without per-user calibration. WRSLT demonstrated high recognition accuracy on large-scale datasets comprising 100 American Sign Language and 100 International Sign Language words, achieving 88.3 and 88.5% accuracy, respectively, under unseen-user conditions (i.e., test users not included in model training). Furthermore, a custom sequential word detection framework enables sentence-level translation from continuous signing input without requiring separate training on entire sentence structures.Keywords
Funding Information
- National Research Foundation of Korea (RS-2024-00353768)
- National Research Foundation of Korea (RS-2025-02217919)
- National Research Foundation of Korea (RS-2025-02215070)
- Samsung Research Funding Center of Samsung Electronics (SRFC-IT1901-08)
- KIST Institutional Program (2E33801)
- KIST Institutional Program (2E33800)
- Artificial Intelligence Graduate School Program at Yonsei University (RS-2020-II201361)
- Yonsei Signature Research Cluster Program of 2024 (2024-22-0161)
- Hankuk University of Foreign Studies Research Fund of 2025
- Gyeonggi Regional Innovation System & Education Projec
- Hankuk University of Foreign Studies Research Fund of 2025
- Gyeonggi Regional Innovation System & Education Projec
- Hankuk University of Foreign Studies Research Fund of 2025
This publication has 38 references indexed in Scilit:
- A wireless, solar-powered, optoelectronic system for spatial restriction-free long-term optogenetic neuromodulationsScience Advances, 2023
- Exploiting domain transformation and deep learning for hand gesture recognition using a low-cost datagloveScientific Reports, 2022
- Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactionsNature Communications, 2022
- Full-Fiber Auxetic-Interlaced Yarn Sensor for Sign-Language Translation Glove Assisted by Artificial Neural NetworkNano-Micro Letters, 2022
- Self‐Powered Gesture Recognition Wristband Enabled by Machine Learning for Full Keyboard and Multicommand InputAdvanced Materials, 2022
- Flexible artificial Si-In-Zn-O/ion gel synapse and its application to sensory-neuromorphic system for sign language translationScience Advances, 2021
- AI enabled sign language recognition and VR space bidirectional communication using triboelectric smart gloveNature Communications, 2021
- Methods, Databases and Recent Advancement of Vision-Based Hand Gesture Recognition for HCI Systems: A ReviewSN Computer Science, 2021
- Wearable Sensor-Based Sign Language Recognition: A Comprehensive ReviewIEEE Reviews in Biomedical Engineering, 2020
- A Wearable System for Recognizing American Sign Language in Real-Time Using IMU and Surface EMG SensorsIEEE Journal of Biomedical and Health Informatics, 2016