Hinglish Cross-Accent Model Agnostic Meta-Learning Automatic Speech Recognition
Open Access
- 10 September 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian and Low-Resource Language Information Processing
- Vol. 24 (9) , 1-18
Abstract
Mother tongues and regional dialects have a substantial impact on pronunciation, leading to a range of complex and unique accents. This complexity increases in a diverse country such as India, which has code-mixed languages, which necessitates the development of an Automatic Speech Recognition(ASR) system capable of accommodating these variations effectively. In order to address this, we suggest a Hinglish voice recognition task that is cross-accented and uses the Hindi+English code-mixed conversational data to evaluate how well a model can adapt to different accents. The model-agnostic meta-learning (MAML) technique is extended by our accent-agnostic method to enable quick adaptation to unknown accents. We show through numerous experiments that our method works well. It outperforms joint multi-accent training in both mixed and cross-region settings, as measured by word error rate(WER), which is enhanced by 3-5%. Further, we investigate the effects of few-shot fine-tuning on mixed and cross-region samples, and ultimately revealing important insights into the pronunciation of Hindi-accented audio across different geographical areas of the country.Keywords
This publication has 11 references indexed in Scilit:
- Generalizable Speech Spoofing Detection Against Silence Trimming With Data Augmentation and Multi-Task Meta-LearningIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024
- IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languages2024
- ASR for Low Resource and Multilingual Noisy Code-Mixed Speech2023
- Meta-Learning for Indian Languages: Performance Analysis and Improvements With Linguistic Similarity MeasuresIEEE Access, 2023
- Learning Fast Adaptation on Cross-Accented Speech Recognition2020
- Code-Switched Language Models Using Neural Based Synthetic Data from Parallel Sentences2019
- Code-Mixing: A Brief Survey2018
- Meta-Learning for Low-Resource Neural Machine Translation2018
- Speech Processing for Hindi Dialect Recognition2014
- Learning to Control Fast-Weight Memories: An Alternative to Dynamic Recurrent NetworksNeural Computation, 1992