Robust Target Speaker Direction of Arrival Estimation
Preprint
Abstract
In multi-speaker environments the direction of arrival (DOA) of a target speaker is key for improving speech clarity and extracting target speaker's voice. However, traditional DOA estimation methods often struggle in the presence of noise, reverberation, and particularly when competing speakers are present. To address these challenges, we propose RTS-DOA, a robust real-time DOA estimation system. This system innovatively uses the registered speech of the target speaker as a reference and leverages full-band and sub-band spectral information from a microphone array to estimate the DOA of the target speaker's voice. Specifically, the system comprises a speech enhancement module for initially improving speech quality, a spatial module for learning spatial information, and a speaker module for extracting voiceprint features. Experimental results on the LibriSpeech dataset demonstrate that our RTS-DOA system effectively tackles multi-speaker scenarios and established new optimal benchmarks.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Hierarchical Speaker Representation for Target Speaker Extraction2024
- SpatialNet: Extensively Learning Spatial Information for Multichannel Joint Speech Separation, Denoising and DereverberationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024
- Signal-aware direction-of-arrival estimation using attention mechanismsComputer Speech & Language, 2022
- Multi-microphone Complex Spectral Mapping for Utterance-wise and Continuous Speech SeparationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021
- Learning Complex Spectral Mapping With Gated Convolutional Recurrent Networks for Monaural Speech EnhancementIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2019
- Conv-TasNet: Surpassing Ideal Time–Frequency Magnitude Masking for Speech SeparationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2019
- Real-time passive source localization: a practical linear-correction least-squares approachIEEE Transactions on Speech and Audio Processing, 2001
- Maximum likelihood methods for direction-of-arrival estimationIEEE Transactions on Acoustics, Speech, and Signal Processing, 1990
- ESPRIT-estimation of signal parameters via rotational invariance techniquesIEEE Transactions on Acoustics, Speech, and Signal Processing, 1989
- Multiple emitter location and signal parameter estimationIEEE Transactions on Antennas and Propagation, 1986