Multi-objective non-intrusive hearing-aid speech assessment model
Open Access
- 1 November 2024
- journal article
- research article
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 156 (5) , 3574-3587
Abstract
Because a reference signal is often unavailable in real-world scenarios, reference-free speech quality and intelligibility assessment models are important for many speech processing applications. Despite a great number of deep-learning models that have been applied to build non-intrusive speech assessment approaches and achieve promising performance, studies focusing on the hearing impaired (HI) subjects are limited. This paper presents HASA-Net+, a multi-objective non-intrusive hearing-aid speech assessment model, building upon our previous work, HASA-Net. HASA-Net+ improves HASA-Net in several ways: (1) inclusivity for both normal-hearing and HI listeners, (2) integration with pre-trained speech foundation models and fine-tuning techniques, (3) expansion of predictive capabilities to cover speech quality and intelligibility in diverse conditions, including noisy, denoised, reverberant, dereverberated, and vocoded speech, thereby evaluating its robustness, and (4) validation of the generalization capability using an out-of-domain dataset.Keywords
All Related Versions
Funding Information
- Academia Sinica (AS-GC-111-M01)
- NSTC (111-2221-E-001-016-MY3)
This publication has 26 references indexed in Scilit:
- A Study On Incorporating Whisper For Robust Speech Assessment2024
- A Non-Intrusive speech quality evaluation algorithm for hearing aids via an auxiliary training taskApplied Acoustics, 2023
- An overview of the HASPI and HASQI metrics for predicting speech intelligibility and speech quality for normal hearing, hearing loss, and hearing aidsHearing Research, 2022
- WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech ProcessingIEEE Journal of Selected Topics in Signal Processing, 2022
- The Hearing-Aid Speech Perception Index (HASPI) Version 2Speech Communication, 2021
- Using Objective Metrics to Measure Hearing Aid PerformanceEar & Hearing, 2018
- Automatic Speech Recognition Predicts Speech Intelligibility and Comprehension for Listeners With Simulated Age-Related Hearing LossJournal of Speech, Language, and Hearing Research, 2017
- A Non-Intrusive Quality and Intelligibility Measure of Reverberant and Dereverberated SpeechIEEE Transactions on Audio, Speech, and Language Processing, 2010
- P.563—The ITU-T Standard for Single-Ended Speech Quality AssessmentIEEE Transactions on Audio, Speech, and Language Processing, 2006
- The National Acoustic Laboratoriesʼ (NAL) New Procedure for Selecting the Gain and Frequency Response of a Hearing AidEar & Hearing, 1986