BSM-iMagLS: ILD Informed Binaural Signal Matching for Reproduction With Head-Mounted Microphone Arrays
Open Access
- 23 June 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech and Language Processing
- Vol. 33, 2705-2718
Abstract
Headphone listening in applications such as augmented and virtual reality (AR and VR) relies on high-quality spatial audio to ensure immersion, making accurate binaural reproduction a critical component. As capture devices, wearable arrays with only a few microphones with irregular arrangement face challenges in achieving a reproduction quality comparable to that of arrays with a large number of microphones. Binaural signal matching (BSM) has recently been presented as a signal-independent approach for generating high-quality binaural signal using only a few microphones, which is further improved using magnitude-least squares (MagLS) optimization at high frequencies. This paper extends BSM with MagLS by introducing interaural level difference (ILD) into the MagLS, integrated into BSM (BSM-iMagLS). Using a deep neural network (DNN)-based solver, BSM-iMagLS achieves joint optimization of magnitude, ILD, and magnitude derivatives, improving spatial fidelity. Performance is validated through theoretical analysis, numerical simulations with diverse HRTFs and head-mounted array geometries, and listening experiments, demonstrating a substantial reduction in ILD errors while maintaining comparable magnitude accuracy to state-of-the-art solutions. The results highlight the potential of BSM-iMagLS to enhance binaural reproduction for wearable and portable devices.Keywords
All Related Versions
Funding Information
- Reality Labs Research @ Meta
This publication has 36 references indexed in Scilit:
- Spatial audio signal processing for binaural reproduction of recorded acoustic scenes – review and challengesActa Acustica, 2022
- Enabling Head-Tracking for Binaural Sound Reproduction Based on Bilateral Ambisonics2021
- End-to-End Magnitude Least Squares Binaural Rendering of Spherical Microphone Array Signals2021
- Ambisonics2019
- COMPASS: Coding and Multidirectional Parameterization of Ambisonic Sound Scenes2018
- Fundamentals of Spherical Array Processing2015
- Virtual reality for architectural acousticsJournal of Building Performance Simulation, 2014
- Optimum Array Processing2002
- The Convergence of a Class of Double-rank Minimization Algorithms 1. General ConsiderationsIMA Journal of Applied Mathematics, 1970
- XII. On our perception of sound directionJournal of Computers in Education, 1907