Natural Listening over Headphones in Augmented Reality Using Adaptive Filtering Techniques
Authors:
- 23 July 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 23 (11) , 1988-2002
Abstract
Augmented reality (AR), which composes of virtual and real world environments, is becoming one of the major topics of research interest due to the advent of wearable devices. Today, AR is commonly used as assistive display to enhance the perception of reality in education, gaming, navigation, sports, entertainment, simulators, etc. However, most of the past works have mainly concentrated on the visual aspects of AR. Auditory events are one of the essential components in human perceptions in daily life but the augmented reality solutions have been lacking in this regard till now compared to visual aspects. Therefore, there is a need of natural listening in AR systems to give a holistic experience to the user. A new headphones configuration is presented in this work with two pairs of binaural microphones attached to headphones (one internal and one external microphone on each side). This paper focuses on enabling natural listening using open headphones employing adaptive filtering techniques to equalize the headset such that virtual sources are perceived as close as possible to sounds emanating from the physical sources. This would also require a superposition of virtual sources with the physical sound sources, as well as ambience. Modified versions of the filtered-x normalized least mean square algorithm (FxNLMS) are proposed in the paper to converge faster to the optimum solution as compared to the conventional FxNLMS. Measurements are carried out with open structure type headphones to evaluate their performance. Subjective test was conducted using individualized binaural room impulse responses (BRIRs) to evaluate the perceptual similarity between real and virtual sounds.Keywords
This publication has 17 references indexed in Scilit:
- Modeling Perceptual Similarity of Audio Signals for Blind Source Separation Evaluation2007
- Estimation of HRTFs on the horizontal plane using physical featuresApplied Acoustics, 2007
- Collaborative augmented realityCommunications of the ACM, 2002
- Near-Field Virtual Audio DisplaysPRESENCE: Virtual and Augmented Reality, 2002
- A Survey of Augmented RealityPRESENCE: Virtual and Augmented Reality, 1997
- Tangible bits1997
- Narrow-band sound localization related to external ear acousticsThe Journal of the Acoustical Society of America, 1992
- Fundamentals of binaural technologyApplied Acoustics, 1992
- Invertibility of a room impulse responseThe Journal of the Acoustical Society of America, 1979
- Spectral cues used in the localization of sound sources on the median planeThe Journal of the Acoustical Society of America, 1974