Weiyi Wei
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Weiyi Wei has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Jianan Yuan
Graduate School of Environmental Science, Hokkaido University, Sapporo 0600810, Japan
1 shared publication - Masahiro Todoh
Hokkaido University
1 shared publication - Sherrine
Graduate School of Engineering, Hokkaido University, Sapporo 0608628, Japan
1 shared publication - Xinya Li
Graduate School of Economics and Business, Hokkaido University, Sapporo 0600809, Japan
1 shared publication - Yutong Gu
Faculty of Informatics, Gunma University, Kiryu 3768515, Japan
1 shared publication
Latest Publications
- Open Access
- 1 December 2022
- Published by MDPI AG in Inventions
- Vol. 7 (4) , 112
American Sign Language Alphabet Recognition Using Inertial Motion Capture System with Deep Learning
Sign language is designed as a natural communication method for the deaf community to convey messages and connect with society. In American sign language, twenty-six special sign gestures from the alphabet are used for the fingerspelling of proper words. The purpose of this research is to classify the hand gestures in the alphabet and recognize a sequence of gestures in the fingerspelling using an inertial hand motion capture system. In this work, time and time-frequency domain features and angle-based features are extracted from the raw data for classification with convolutional neural network-based classifiers. In fingerspelling recognition, we explore two kinds of models: connectionist temporal classification and encoder-decoder structured sequence recognition model. The study reveals that the classification model achieves an average accuracy of 74.8% for dynamic ASL gestures considering user independence. Moreover, the proposed two sequence recognition models achieve 55.1%, 93.4% accuracy in word-level evaluation, and 86.5%, 97.9% in the letter-level evaluation of fingerspelling. The proposed method has the potential to recognize more hand gestures of sign language with highly reliable inertial data from the device.
- 1 December 2022
- Published by MDPI AG in Inventions
- Vol. 7 (4) , 112
Open AccessAmerican Sign Language Alphabet Recognition Using Inertial Motion Capture System with Deep Learning
Sign language is designed as a natural communication method for the deaf community to convey messages and connect with society. In American sign language, twenty-six special sign gestures from the alphabet are used for the fingerspelling of proper words. The purpose of this research is to classify the hand gestures in the alphabet and recognize a sequence of gestures in the fingerspelling using an inertial hand motion capture system. In this work, time and time-frequency domain features and angle-based features are extracted from the raw data for classification with convolutional neural network-based classifiers. In fingerspelling recognition, we explore two kinds of models: connectionist temporal classification and encoder-decoder structured sequence recognition model. The study reveals that the classification model achieves an average accuracy of 74.8% for dynamic ASL gestures considering user independence. Moreover, the proposed two sequence recognition models achieve 55.1%, 93.4% accuracy in word-level evaluation, and 86.5%, 97.9% in the letter-level evaluation of fingerspelling. The proposed method has the potential to recognize more hand gestures of sign language with highly reliable inertial data from the device.