Adapting Off-the-Shelf Speech Recognition Systems for Novel Words
Open Access
- 13 March 2023
- journal article
- research article
- Published by MDPI AG in Information
- Vol. 14 (3) , 179
Abstract
Current speech recognition systems with fixed vocabularies have difficulties recognizing Out-of-Vocabulary words (OOVs) such as proper nouns and new words. This leads to misunderstandings or even failures in dialog systems. Ensuring effective speech recognition is crucial for the proper functioning of robot assistants. Non-native accents, new vocabulary, and aging voices can cause malfunctions in a speech recognition system. If this task is not executed correctly, the assistant robot will inevitably produce false or random responses. In this paper, we used a statistical approach based on distance algorithms to improve OOV correction. We developed a post-processing algorithm to be combined with a speech recognition model. In this sense, we compared two distance algorithms: Damerau–Levenshtein and Levenshtein distance. We validated the performance of the two distance algorithms in conjunction with five off-the-shelf speech recognition models. Damerau–Levenshtein, as compared to the Levenshtein distance algorithm, succeeded in minimizing the Word Error Rate (WER) when using the MoroccanFrench test set with five speech recognition systems, namely VOSK API, Google API, Wav2vec2.0, SpeechBrain, and Quartznet pre-trained models. Our post-processing method works regardless of the architecture of the speech recognizer, and its results on our MoroccanFrench test set outperformed the five chosen off-the-shelf speech recognizer systems.Keywords
This publication has 24 references indexed in Scilit:
- Dynamic Acoustic Unit Augmentation with BPE-Dropout for Low-Resource End-to-End Speech RecognitionSensors, 2021
- Improving Amharic Speech Recognition System Using Connectionist Temporal Classification with Attention Model and Phoneme-Based Byte-Pair-EncodingsInformation, 2021
- Robot vs. Voice Assistant2020
- Post Text Processing of Chinese Speech Recognition Based on Bidirectional LSTM Networks and CRFElectronics, 2019
- Rule-Based Pronunciation Models to Handle OOV Words for Indonesian Automatic Speech Recognition System2019
- Automatic Speech Recognition Errors Detection and Correction: A ReviewProcedia Computer Science, 2018
- Evaluating Spoken Dialogue Processing for Time-Offset Interaction2015
- Error correction of automatic speech recognition based on normalized web distance2014
- An improved two-stage mixed language model approach for handling out-of-vocabulary words in large vocabulary continuous speech recognitionComputer Speech & Language, 2014
- Context-based speech recognition error detection and correction2004