Microscopic and Blind Prediction of Speech Intelligibility: Theory and Practice
- 30 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 30 (23299290) , 2141-2155
Abstract
Being able to estimate speech intelligibility without the need for listening tests would confer great benefits for a wide range of speech processing applications. Many attempts have therefore been made to introduce an objective, and ideally reference-free measure for this purpose. Most works analyze speech intelligibility prediction (SIP) methods from a macroscopic point of view, averaging over longer time spans. This paper, in contrast, presents a theoretical framework for the microscopic evaluation of SIP methods. Within our framework, a Statistically estimated Accuracy based on Theory (StAT) is derived, which numerically quantifies the statistical limitations inherent in microscopic SIP. A state-of-the-art approach to microscopic SIP, namely, the use of automatic speech recognition (ASR) to directly predict listening test results, is evaluated within this framework. The practical results are in good agreement with the theory. As the final contribution, a fully blind DIscriminative Speech intelligibility Predictor (DISP) is introduced and is also evaluated within the StAT framework. It is shown that this novel, blind estimator can predict intelligibility as well as—and often even with better accuracy than—the non-blind ASR-based approach, and that its results are again in good agreement with its theoretically derived performance potential.Keywords
Funding Information
- European Union’s Seventh Framework Programme (FP7/2007-2013/)
- REA (317521)
- NSF (PHY17-48958)
- NIH (R25GM067110)
This publication has 52 references indexed in Scilit:
- Perceptual Properties of Current Speech Recognition TechnologyProceedings of the IEEE, 2013
- A multi-resolution envelope-power based model for speech intelligibilityThe Journal of the Acoustical Society of America, 2013
- Predicting speech intelligibility based on the signal-to-noise envelope power ratio after modulation-frequency selective processingThe Journal of the Acoustical Society of America, 2011
- Microscopic prediction of speech recognition for listeners with normal hearing in noise using an auditory modelThe Journal of the Acoustical Society of America, 2009
- Modelling speaker intelligibility in noiseSpeech Communication, 2007
- A spectro-temporal modulation index (STMI) for assessment of speech intelligibilitySpeech Communication, 2003
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- Sentences for Testing Speech Intelligibility in NoiseScandinavian Audiology, 1982
- A physical method for measuring speech-transmission qualityThe Journal of the Acoustical Society of America, 1980
- Factors Governing the Intelligibility of Speech SoundsThe Journal of the Acoustical Society of America, 1947