Linguistic disparities in cross-language automatic speech recognition transfer from Arabic to Tashlhiyt
Authors:
Open Access
- 3 January 2024
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 14 (1) , 1-9
Abstract
Tashlhiyt is a low-resource language with respect to acoustic databases, language corpora, and speech technology tools, such as Automatic Speech Recognition (ASR) systems. This study investigates whether a method of cross-language re-use of ASR is viable for Tashlhiyt from an existing commercially-available system built for Arabic. The source and target language in this case have similar phonological inventories, but Tashlhiyt permits typologically rare phonological patterns, including vowelless words, while Arabic does not. We find systematic disparities in ASR transfer performance (measured as word error rate (WER) and Levenshtein distance) for Tashlhiyt across word forms and speaking style variation. Overall, performance was worse for casual speaking modes across the board. In clear speech, performance was lower for vowelless than for voweled words. These results highlight systematic speaking mode- and phonotactic-disparities in cross-language ASR transfer. They also indicate that linguistically-informed approaches to ASR re-use can provide more effective ways to adapt existing speech technology tools for low resource languages, especially when they contain typologically rare structures. The study also speaks to issues of linguistic disparities in ASR and speech technology more broadly. It can also contribute to understanding the extent to which machines are similar to, or different from, humans in mapping the acoustic signal to discrete linguistic representations.Keywords
This publication has 46 references indexed in Scilit:
- Random effects structure for confirmatory hypothesis testing: Keep it maximalJournal of Memory and Language, 2013
- Bidirectional clear speech perception benefit for native and high-proficiency non-native talkers and listeners: Intelligibility and accentednessThe Journal of the Acoustical Society of America, 2011
- Quantifying temporal speech reduction in French using forced speech alignmentJournal of Phonetics, 2011
- On the Internal Structure of Tashlhiyt Berber Triconsonantal RootsLinguistic Inquiry, 2010
- Syllables without vowels: phonetic and phonological evidence from Tashlhiyt BerberPhonology, 2008
- Intraspeaker variability in vowel production: An investigation of motherese, hyperspeech, and Lombard speech in Jamaican speakersJournal of Phonetics, 2007
- Production and perception of clear speech in Croatian and EnglishThe Journal of the Acoustical Society of America, 2005
- Investigating syllabic structures and their variation in spontaneous FrenchSpeech Communication, 2005
- Explaining Phonetic Variation: A Sketch of the H&H Theory1990
- Speech Timing as a Tool in PhonologyPhonetica, 1981