Modelling individual head‐related transfer function (HRTF) based on anthropometric parameters and generic HRTF amplitudes
Authors:
Open Access
- 22 February 2023
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in CAAI Transactions on Intelligence Technology
- Vol. 8 (2) , 364-378
Abstract
The head‐related transfer function (HRTF) plays a vital role in immersive virtual reality and augmented reality technologies, especially in spatial audio synthesis for binaural reproduction. This article proposes a deep learning method with generic HRTF amplitudes and anthropometric parameters as input features for individual HRTF generation. By designing fully convolutional neural networks, the key anthropometric parameters and the generic HRTF amplitudes were used to predict each individual HRTF amplitude spectrum in the full‐space directions, and the interaural time delay (ITD) was predicted by the transformer module. In the amplitude prediction model, the attention mechanism was adopted to better capture the relationship of HRTF amplitude spectra at two distinctive directions with large angle differences in space. Finally, with the minimum phase model, the predicted amplitude spectrum and ITDs were used to obtain a set of individual head‐related impulse responses. Besides the separate training of the HRTF amplitude and ITD generation models, their joint training was also considered and evaluated. The root‐mean‐square error and the log‐spectral distortion were selected as objective measurement metrics to evaluate the performance. Subjective experiments further showed that the auditory source localisation performance of the proposed method was better than other methods in most cases.Keywords
This publication has 21 references indexed in Scilit:
- Fully convolutional networks for semantic segmentation2015
- HRTF personalization modeling based on RBF neural network2013
- HRTF personalization based on artificial neural network in individual virtual auditory spaceApplied Acoustics, 2008
- Boundary element simulations of the transfer function of human heads and baffled pinnae using accurate geometric modelsJournal of Sound and Vibration, 2007
- HRTF personalization using anthropometric measurements2004
- On the minimum-phase approximation of head-related transfer functions2002
- The CIPIC HRTF database2002
- Computational model of an individual head-related transfer function using the BEMThe Journal of the Acoustical Society of America, 1999
- Localization using nonindividualized head-related transfer functionsThe Journal of the Acoustical Society of America, 1993
- Localization with non-individualized virtual acoustic display cues1991