An experimental study on the role of software synthesized 3D sound in augmented reality environments
- 1 October 2004
- journal article
- Published by Oxford University Press (OUP) in Interacting with Computers
- Vol. 16 (5) , 989-1016
Abstract
Investigation of augmented reality (AR) environments has become a popular research topic for engineers, computer and cognitive scientists. Although application oriented studies focused on audio AR environments have been published, little work has been done to vigorously study and evaluate the important research questions of the effectiveness of 3D sound in the AR context, and to what extent the addition of 3D sound would contribute to the AR experience. Thus, we have developed two AR environments and performed vigorous experiments with human subjects to study the effects of 3D sound in the AR context. The study concerns two scenarios. In the first scenario, one participant must use vision only and vision with 3D sound to judge the relative depth of augmented virtual objects. In the second scenario, two participants must co-operate to perform a joint task in a game-based AR environment. Hence, the goals of this study are (1) to access the impact of 3D sound on depth perception in a single-camera AR environment, (2) to study the impact of 3D sound on task performance and the feeling of ‘human presence and collaboration’, (3) to better understand the role of 3D sound in human-computer and human–human interactions, (4) to investigate if gender can affect the impact of 3D sound in AR environments. The outcomes of this research can have a useful impact on the development of audio AR systems which provide more immersive, realistic and entertaining experiences by introducing 3D sound. Our results suggest that 3D sound in AR environment significantly improves the accuracy of depth judgment and improves task performance. Our results also suggest that 3D sound contributes significantly to the feeling of ‘human presence and collaboration’ and helps the subjects to ‘identify spatial objects’.Keywords
This publication has 20 references indexed in Scilit:
- Marker tracking and HMD calibration for a video-based augmented reality conferencing system2003
- A wearable spatial conferencing space2002
- A stereo vision-based augmented reality system with an inertial sensor2002
- Development of a stereo video see-through HMD for AR systems2002
- Occlusion in collaborative augmented environmentsComputers & Graphics, 1999
- Natural feature tracking for augmented realityIEEE Transactions on Multimedia, 1999
- A Survey of Augmented RealityPRESENCE: Virtual and Augmented Reality, 1997
- Visual and Auditory Localization as a Function of Azimuth and ElevationThe International Journal of Aviation Psychology, 1997
- Resolving occlusion in augmented reality1995
- Sound Localization by Human ListenersAnnual Review of Psychology, 1991