TalTech Systems for the Interspeech 2025 ML-SUPERB 2.0 Challenge
Preprint
Abstract
This paper describes the language identification and multilingual speech recognition system developed at Tallinn University of Technology for the Interspeech 2025 ML-SUPERB 2.0 Challenge. A hybrid language identification system is used, consisting of a pretrained language embedding model and a light-weight speech recognition model with a shared encoder across languages and language-specific bigram language models. For speech recognition, three models are used, where only a single model is applied for each language, depending on the training data availability and performance on held-out data. The model set consists of a finetuned version of SeamlessM4T, MMS-1B-all with custom language adapters and MMS-zeroshot. The system obtained the top overall score in the challenge.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Scaling A Simple Approach to Zero-Shot Speech Recognition2025
- Leveraging the Multilingual Indonesian Ethnic Languages Dataset In Self-Supervised Models for Low-Resource ASR Task2023
- Thai Dialect Corpus and Transfer-based Curriculum Learning Investigation for Dialect Automatic Speech Recognition2023
- GlotLID: Language Identification for Low-Resource Languages2023
- Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation2022
- Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates2018