Speech Enhancement for Hearing Aids with Deep Learning on Environmental Noises
Open Access
- 2 September 2020
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 10 (17) , 6077
Abstract
Hearing aids are small electronic devices designed to improve hearing for persons with impaired hearing, using sophisticated audio signal processing algorithms and technologies. In general, the speech enhancement algorithms in hearing aids remove the environmental noise and enhance speech while still giving consideration to hearing characteristics and the environmental surroundings. In this study, a speech enhancement algorithm was proposed to improve speech quality in a hearing aid environment by applying noise reduction algorithms with deep neural network learning based on noise classification. In order to evaluate the speech enhancement in an actual hearing aid environment, ten types of noise were self-recorded and classified using convolutional neural networks. In addition, noise reduction for speech enhancement in the hearing aid were applied by deep neural networks based on the noise classification. As a result, the speech quality based on the speech enhancements removed using the deep neural networks—and associated environmental noise classification—exhibited a significant improvement over that of the conventional hearing aid algorithm. The improved speech quality was also evaluated by objective measure through the perceptual evaluation of speech quality score, the short-time objective intelligibility score, the overall quality composite measure, and the log likelihood ratio score.Keywords
Funding Information
- National Research Foundation of Korea (NRF-2020R1A2C2004624)
This publication has 31 references indexed in Scilit:
- An algorithm that improves speech intelligibility in noise for normal-hearing listenersThe Journal of the Acoustical Society of America, 2009
- Subjective comparison and evaluation of speech enhancement algorithmsSpeech Communication, 2007
- Noise spectrum estimation in adverse environments: improved minima controlled recursive averagingIEEE Transactions on Speech and Audio Processing, 2003
- Assessment for automatic speech recognition: II. NOISEX-92: A database and an experiment to study the effect of additive noise on speech recognition systemsSpeech Communication, 1993
- Effects of fluctuating noise and interfering speech on the speech-reception threshold for impaired and normal hearingThe Journal of the Acoustical Society of America, 1990
- Learning representations by back-propagating errorsNature, 1986
- Speech enhancement using a minimum mean-square error log-spectral amplitude estimatorIEEE Transactions on Acoustics, Speech, and Signal Processing, 1985
- Effect of a single interfering noise or speech source upon the binaural sentence intelligibility of aged personsThe Journal of the Acoustical Society of America, 1983
- Auditory handicap of hearing impairment and the limited benefit of hearing aidsThe Journal of the Acoustical Society of America, 1978
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958