A Combined Method for Localizing Two Overlapping Acoustic Sources Based on Deep Learning
Open Access
- 16 June 2025
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 15 (12) , 6768
Abstract
Deep learning approaches for multi-source sound localization face significant challenges, particularly the need for extensive training datasets encompassing diverse spatial configurations to achieve robust generalization. This requirement leads to substantial computational demands, which are further exacerbated when localizing overlapping sources in complex acoustic environments with reverberation and noise. In this paper, a new methodology is proposed for simultaneous localization of two overlapping sound sources in the time–frequency domain in a closed, reverberant environment with a spatial resolution of using a small-sized microphone array. The proposed methodology is based on the integration of the sound source separation method with a single-source sound localization model. A hybrid model was proposed to separate the sound source signals received by each microphone in the array. The model was built using a bidirectional long short-term memory (BLSTM) network and trained on a dataset using the ideal binary mask (IBM) as the training target. The modeling results show that the proposed localization methodology is efficient in determining the directions for two overlapping sources simultaneously, with an average localization accuracy of 86.1% for the test dataset containing short-term signals of 500 ms duration with different signal-to-signal ratio values.
Keywords
This publication has 21 references indexed in Scilit:
- Deep learning based multi-source localization with source splitting and its effectiveness in multi-talker speech recognitionComputer Speech & Language, 2022
- Deep learning assisted sound source localization using two orthogonal first-order differential microphone arraysThe Journal of the Acoustical Society of America, 2021
- Robust Source Counting and DOA Estimation Using Spatial Pseudo-Spectrum and Convolutional Neural NetworkIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2020
- Acoustic beamforming for noise source localization – Reviews, methodology and applicationsMechanical Systems and Signal Processing, 2019
- Multi-Speaker DOA Estimation Using Deep Convolutional Networks Trained With Noise SignalsIEEE Journal of Selected Topics in Signal Processing, 2019
- Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural NetworksIEEE Journal of Selected Topics in Signal Processing, 2018
- A Modified SRP-PHAT Functional for Robust Real-Time Sound Source Localization With Scalable Spatial SamplingIEEE Signal Processing Letters, 2010
- Multiple emitter location and signal parameter estimationIEEE Transactions on Antennas and Propagation, 1986
- Image method for efficiently simulating small-room acousticsThe Journal of the Acoustical Society of America, 1979
- The generalized correlation method for estimation of time delayIEEE Transactions on Acoustics, Speech, and Signal Processing, 1976