A Review on Sound Source Localization in Robotics: Focusing on Deep Learning Methods
Open Access
- 26 August 2025
- journal article
- review article
- Published by MDPI AG in Applied Sciences
- Vol. 15 (17) , 9354
Abstract
Sound source localization (SSL) adds a spatial dimension to auditory perception, allowing a system to pinpoint the origin of speech, machinery noise, warning tones, or other acoustic events, capabilities that facilitate robot navigation, human–machine dialogue, and condition monitoring. While existing surveys provide valuable historical context, they typically address general audio applications and do not fully account for robotic constraints or the latest advancements in deep learning. This review addresses these gaps by offering a robotics-focused synthesis, emphasizing recent progress in deep learning methodologies. We start by reviewing classical methods such as time difference of arrival (TDOA), beamforming, steered-response power (SRP), and subspace analysis. Subsequently, we delve into modern machine learning (ML) and deep learning (DL) approaches, discussing traditional ML and neural networks (NNs), convolutional neural networks (CNNs), convolutional recurrent neural networks (CRNNs), and emerging attention-based architectures. The data and training strategy that are the two cornerstones of DL-based SSL are explored. Studies are further categorized by robot types and application domains to facilitate researchers in identifying relevant work for their specific contexts. Finally, we highlight the current challenges in SSL works in general, regarding environmental robustness, sound source multiplicity, and specific implementation constraints in robotics, as well as data and learning strategies in DL-based SSL. Also, we sketch promising directions to offer an actionable roadmap toward robust, adaptable, efficient, and explainable DL-based SSL for next-generation robots.Keywords
All Related Versions
This publication has 215 references indexed in Scilit:
- Multiple Sound Sources Localization Using Sub-Band Spatial Features and Attention MechanismCircuits, Systems, and Signal Processing, 2024
- Sound source localization for auditory perception of a humanoid robot using deep neural networksNeural Computing and Applications, 2022
- A Review on Sound Source Localization SystemsArchives of Computational Methods in Engineering, 2022
- A survey of transformersAI Open, 2022
- A Review of Indoor Localization Techniques and Wireless TechnologiesWireless Personal Communications, 2021
- gpuRIR: A python library for room impulse response simulation with GPU accelerationMultimedia Tools and Applications, 2020
- Realtime Active Sound Source Localization for Unmanned Ground Robots Using a Self-Rotational Bi-Microphone ArrayJournal of Intelligent & Robotic Systems, 2018
- Improved sound source localization in horizontal plane for binaural robot auditionApplied Intelligence, 2014
- Vision‐based robotic person following under light variations and difficult walking maneuversJournal of Field Robotics, 2010
- Sound Source DOA Estimation and Localization in Noisy Reverberant Environments Using Least-Squares Support Vector MachinesJournal of Signal Processing Systems, 2009