A Wearable Device of 360° Speech Tracking and Enhancement for Hearing Loss Students in Class

Authors:
Publisher website
Google Scholar
Abstract
This research proposed a new wearable device with microphone array and camera speech tracking and enhancement over a full range of 360-degree of a specific speaker. The proposed sensing method that combined computer vision and voice techniques to track the speech target in a flexible manner. The device could scan the specific speech source over 360°, and reduces the noise due to the interference, thus enhancing the auto-scan hearing-impaired process this helps students with hearing loss to concentrate more easily during the learning process in the class. The experimental results indicated that the proposed method could locate the noise source far from the target by more than 30°, regardless of whether the computer vision detected the human face or not. The measured positioning accuracy is greater than 83% within a range of 360-degree and the speech could be enhanced by at least 5.2 dB. The proposed wearable design for schoolchildren with speech recording also has the potential to be a tool for review class.
Funding Information
  • National Science and Technology Council, Taiwan (111-2622-E-006 -007 - and 110-2221-E-006 -087 -MY3)

This publication has 27 references indexed in Scilit: