Keyword Guided Target Speech Recognition
- 23 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 31 (10709908) , 1945-1949
Abstract
This letter presents a new target speech recognition problem, where the target speech is defined by a keyword. For instance, when a person speaks “Hey Google” or “Help Me”, we hope the model can recognize the entire contextual speech of that person, even with strong interference speech from other people. The new problem is denoted by target content ASR (TCASR). The core challenge of TC-ASR is that the model needs to simultaneously detect the existence of the keyword from heavily mixed speech and recognize the target speech component using the information of the detected keyword segment. Surprisingly, our experiments show that an attention encoder-decoder (AED) model augmented with a keyword encoder can solve this problem pretty well. We also defined a key content spotting (KCS) task and tested the proposed model on it. Our experiments on the LibriMix dataset demonstrated that our approach could address the KCS task with a promising accuracy, outperforming two baseline models by a large margin. Further analysis shows that the proposed model identifies the target speech by a timbre cue, i.e., ensuring that the identified speech is coherent in speaker trait.Keywords
Funding Information
- China NSFC projects (U62376071)
This publication has 36 references indexed in Scilit:
- Multi-Task Learning with Cross Attention for Keyword Spotting2021
- Recent Developments on Espnet Toolkit Boosted By Conformer2021
- Hypothesis Stitcher for End-to-End Speaker-Attributed ASR on Long-Form Multi-Talker Recordings2021
- A Comparative Study on Transformer vs RNN in Speech Applications2019
- Knowledge Transfer in Permutation Invariant Training for Single-Channel Multi-Talker Speech Recognition2018
- End-to-End Multi-Speaker Speech Recognition2018
- Joint CTC-attention based end-to-end speech recognition using multi-task learning2017
- Permutation invariant training of deep models for speaker-independent multi-talker speech separationMechanical Engineering Journal, 2017
- Listen, attend and spell: A neural network for large vocabulary conversational speech recognition2016
- Librispeech: An ASR corpus based on public domain audio books2015