Adversarial Meta Learning Improves Low-Resource Speech Recognition
Authors:
- 9 December 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
Low-resource automatic speech recognition is a chal- lenging task. To solve this issue, multilingual meta-learning learns a better model initialization from many source language tasks, allowing for rapid adaption to the target language. However, due to the lack of limitations on multilingual pre-training, the shared semantic space of different languages is difficult to learn. In this work, we propose an adversarial meta-learning training approach to solve this problem. By using the adversarial auxiliary aim of language identification in the meta-learning algorithm, it will guide the model encoder to generate language-independent embedding features, which can improve model generalization. And we use Wasserstein distance and temporal normalization to optimize our adversarial training, making the training more stable and easier. The approach is evaluated on the IARPA BABEL. The results reveal that our approach only requires half as many meta learning training epochs to attain comparable multilingual pre-training performance. It also outperforms the meta learning in all target languages fine-tuning and achieves comparable performance in small data scales. Specially, it can reduce CER from 71% to 62% with fine-tuning 25% of Vietnamese data. Finally, we show why our approach is superior than others by using t-SNE.Keywords
Funding Information
- National Natural Science Foundation of China
- Natural Science Foundation of Henan Province
This publication has 18 references indexed in Scilit:
- SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition2019
- Massively Multilingual Adversarial Speech Recognition2019
- Adversarial Multilingual Training for Low-Resource Speech Recognition2018
- Multilingual Speech Recognition with a Single End-to-End Model2018
- Domain Adversarial Training for Accented Speech Recognition2018
- Sequence-Based Multi-Lingual Low Resource Speech Recognition2018
- English Conversational Telephone Speech Recognition by Humans and Machines2017
- Joint CTC-attention based end-to-end speech recognition using multi-task learning2017
- Neural Machine Translation of Rare Words with Subword Units2016
- Connectionist temporal classification2006