Single-channel Speech Extraction Using Speaker Inventory and Attention Network
Authors:
- 1 May 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 86-90
Abstract
Neural network-based speech separation has received a surge of interest in recent years. Previously proposed methods either are speaker independent or extract a target speaker's voice by using his or her voice snippet. In applications such as home devices or office meeting transcriptions, a possible speaker list is available, which can be leveraged for speech separation. This paper proposes a novel speech extraction method that utilizes an inventory of voice snippets of possible interfering speakers, or speaker enrollment data, in addition to that of the target speaker. Furthermore, an attention-based network architecture is proposed to form time-varying masks for both the target and other speakers during the separation process. This architecture does not reduce the enrollment audio of each speaker into a single vector, thereby allowing each short time frame of the input mixture signal to be aligned and accurately compared with the enrollment signals. We evaluate the proposed system on a speaker extraction task derived from the Libri corpus and show the effectiveness of the method.Keywords
This publication has 23 references indexed in Scilit:
- Looking to listen at the cocktail partyACM Transactions on Graphics, 2018
- Efficient Integration of Fixed Beamformers and Speech Separation Networks for Multi-Channel Far-Field Speech Separation2018
- Speaker-Aware Neural Network Based Beamformer for Speaker Extraction in Speech Mixtures2017
- Deep attractor network for single-microphone speaker separation2017
- Permutation invariant training of deep models for speaker-independent multi-talker speech separationMechanical Engineering Journal, 2017
- End-to-End attention based text-dependent speaker verification2017
- Deep clustering: Discriminative embeddings for segmentation and separation2016
- An Overview of Noise-Robust Automatic Speech RecognitionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- Performance measurement in blind audio source separationIEEE Transactions on Audio, Speech, and Language Processing, 2006
- Learning to forget: continual prediction with LSTM1999