Practical utility of a head-mounted gaze-directed beamforming system
Authors:
Open Access
- 1 December 2023
- journal article
- research article
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 154 (6) , 3760-3768
Abstract
Assistive auditory devices that enhance signal-to-noise ratio must follow the user's changing attention; errors could lead to the desired source being suppressed as noise. A method for measuring the practical benefit of attention-following speech enhancement is described and used to show a benefit for gaze-directed beamforming over natural binaural hearing. First, participants watched a recorded video conference call between two people with six additional interfering voices in different directions. The directions of the target voices corresponded to the spatial layout of their video streams. A simulated beamformer was yoked to the participant's gaze direction using an eye tracker. For the control condition, all eight voices were spatially distributed in a simulation of unaided binaural hearing. Participants completed questionnaires on the content of the conversation, scoring twice as high in the questionnaires for the beamforming condition. Sentence-by-sentence intelligibility was then measured using new participants who viewed the same audiovisual stimulus for each isolated sentence. Participants recognized twice as many words in the beamforming condition. The results demonstrate the potential practical benefit of gaze-directed beamforming for hearing aids and illustrate how detailed intelligibility data can be retrieved from an experiment that involves behavioral engagement in an ongoing listening task.Keywords
This publication has 26 references indexed in Scilit:
- A Binaural Steering Beamformer System for Enhancing a Moving Speech SourceTrends in Hearing, 2015
- Benefits of Acoustic Beamforming for Solving the Cocktail Party ProblemTrends in Hearing, 2015
- Unaddressed participants’ gaze in multi-person interaction: optimizing recipiencyFrontiers in Psychology, 2015
- Design and preliminary testing of a visually guided hearing aidThe Journal of the Acoustical Society of America, 2013
- Universals and cultural variation in turn-taking in conversationProceedings of the National Academy of Sciences of the United States of America, 2009
- Differential Microphone Arrays2004
- HRTF measurements of a KEMARThe Journal of the Acoustical Society of America, 1995
- On the potential of fixed arrays for hearing aidsThe Journal of the Acoustical Society of America, 1993
- Development of a directional hearing instrument based on array technologyThe Journal of the Acoustical Society of America, 1993
- The host windowing technique for FIR digital filter designIEEE Transactions on Acoustics, Speech, and Signal Processing, 1984