Acoustic Metadata Design on Object-Based Audio Using Estimated 3D-Position from Visual Image Toward Depth-Directional Sound Image Localization
Open Access
Abstract
Multichannel audio is a sound field reproduction technology that uses multiple loudspeakers. Object-based audio is a playback method for multichannel audio that enables the construction of sound images at specified positions using coordinates within the playback space. However, the sound image positions must be manually specified by audio content creators, which increases the production workload, especially for works containing many sound images or feature films. We have previously proposed a method to reduce the workload of content creators by constructing sound images based on object positions in visual images. However, a significant challenge remains since depth localization of the sound image is not accurate enough. This paper aims to improve localization accuracy by changing the range of sound image movement along the depth direction. To confirm the localization accuracy of sound images constructed using the proposed method, we conducted a subjective evaluation experiment. The experiment identified the optimal movement range by presenting participants with visual images synchronized with sound images moving across varying spatial scales. Consequently, we were able to identify the range of sound image movement in the depth direction necessary for presenting sound images with high consistency with the visual images.Keywords
Funding Information
- Ritsumeikan University R-GIRO, ARC and RARA (JP23K28115)
- Ritsumeikan University R-GIRO, ARC and RARA (JP25H01158)
This publication has 28 references indexed in Scilit:
- Spatial Analysis and Synthesis Methods: Subjective and Objective Evaluations Using Various Microphone Arrays in the Auralization of a Critical Listening RoomIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024
- Effects of type of early reflection, clarity of speech, reverberation and diffuse noise on the spatial perception of a speech source and its intelligibilityThe Journal of the Acoustical Society of America, 2022
- The Effect of Partial Time-Frequency Masking of the Direct Sound on the Perception of Reverberant SpeechIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021
- Toward realistic binaural auralizations – perceptual comparison between measurement and simulation-based auralizations and the real room for a classroom scenarioActa Acustica, 2021
- An Audio-Visual System for Object-Based Audio: From Recording to ListeningIEEE Transactions on Multimedia, 2018
- Ventriloquism effect with sound stimuli varying in both azimuth and elevationThe Journal of the Acoustical Society of America, 2015
- MPEG-H 3D Audio—The New Standard for Coding of Immersive Spatial AudioIEEE Journal of Selected Topics in Signal Processing, 2015
- Ventriloquism effect and aftereffect in the distance dimensionThe Journal of the Acoustical Society of America, 2013
- The Ventriloquist Effect Results from Near-Optimal Bimodal IntegrationCurrent Biology, 2004
- Speech segregation based on sound localizationThe Journal of the Acoustical Society of America, 2003