Yuchen Tan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yuchen Tan has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Chongchong Yu
Beijing Technology and Business University
1 shared publication - Jiaqi Yu
School of Artificial Intelligence, Beijing Technology and Business University, Beijing 100048, China
1 shared publication - Zhaopeng Qian
School of Computer and Artificial Intelligence of Beijing Technology and Business University, China
1 shared publication
Latest Publications
- Open Access
- 17 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 190-195
Endangered Tujia language Speech Recognition Research based on Audio-Visual Fusion
As an endangered language, Tujia language is a non-renewable intangible cultural resource. Automatic speech recognition (ASR) uses artificial intelligence technology to facilitate manually label Tujia language, which is an effective means to protect this language. However, due to the fact that Tujia language has few native speakers, few labeled corpus, and much noise in the corpus. The acoustic models thus suffer from over fitting and lowe noise immunity, which seriously harms the accuracy of recognition. To tackle the deficiencies, an approach of audio-visual speech recognition (AVSR) based on Transformer-CTC is proposed, which reduces the dependence of acoustic models on noise and the quantity of data by introducing visual modality in-formation including lip movements. Specifically, the new approach enhances the expression of speakers’ feature space through the fusion of audio and visual information, thus solving the problem of less available information for single modality. Experiment results show that the optimal CER of AVSR is 8.2% lower than that of traditional models, and 11.8% lower than that for lip reading. The proposed AVSR tackles the issue of low accuracy in recognizing endangered languages. Therefore, AVSR is of great significance in studying the protection and preservation of endangered languages through AI.
- 17 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 190-195
Open AccessEndangered Tujia language Speech Recognition Research based on Audio-Visual Fusion
As an endangered language, Tujia language is a non-renewable intangible cultural resource. Automatic speech recognition (ASR) uses artificial intelligence technology to facilitate manually label Tujia language, which is an effective means to protect this language. However, due to the fact that Tujia language has few native speakers, few labeled corpus, and much noise in the corpus. The acoustic models thus suffer from over fitting and lowe noise immunity, which seriously harms the accuracy of recognition. To tackle the deficiencies, an approach of audio-visual speech recognition (AVSR) based on Transformer-CTC is proposed, which reduces the dependence of acoustic models on noise and the quantity of data by introducing visual modality in-formation including lip movements. Specifically, the new approach enhances the expression of speakers’ feature space through the fusion of audio and visual information, thus solving the problem of less available information for single modality. Experiment results show that the optimal CER of AVSR is 8.2% lower than that of traditional models, and 11.8% lower than that for lip reading. The proposed AVSR tackles the issue of low accuracy in recognizing endangered languages. Therefore, AVSR is of great significance in studying the protection and preservation of endangered languages through AI.