Code-Switching Detection with Data-Augmented Acoustic and Language Models
Preprint
Abstract
In this paper, we investigate the code-switching detection performance of a code-switching (CS) automatic speech recognition (ASR) system with data-augmented acoustic and language models. We focus on the recognition of Frisian-Dutch radio broadcasts where one of the mixed languages, namely Frisian, is under-resourced. Recently, we have explored how the acoustic modeling (AM) can benefit from monolingual speech data belonging to the high-resourced mixed language. For this purpose, we have trained state-of-the-art AMs on a significantly increased amount of CS speech by applying automatic transcription and monolingual Dutch speech. Moreover, we have improved the language model (LM) by creating CS text in various ways including text generation using recurrent LMs trained on existing CS text. Motivated by the significantly improved CS ASR performance, we delve into the CS detection performance of the same ASR system in this work by reporting CS detection accuracies together with a detailed detection error analysis.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Low Latency Acoustic Modeling Using Temporal Convolution and LSTMsIEEE Signal Processing Letters, 2017
- Building a First Language Model for Code-switch Arabic-EnglishProcedia Computer Science, 2017
- Phonetisaurus: Exploring grapheme-to-phoneme conversion with joint n-gram models in the WFST frameworkNatural Language Engineering, 2015
- Code-Switching Event Detection by Using a Latent Language Space Model and the Delta-Bayesian Information CriterionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015
- Recurrent neural network language model training with noise contrastive estimation for speech recognition2015
- Language identification of code Switching sentences and multilingual sentences of under-resourced languages by using multi structural word information2014
- Recurrent neural network language modeling for code switching conversational speech2013
- Codeswitching with English: types of switching, types of communitiesWorld Englishes, 1989