A Multi-Views Multi-Learners Approach Towards Dysarthric Speech Recognition Using Multi-Nets Artificial Neural Networks
- 11 March 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 22 (5) , 1053-1063
Abstract
Automatic speech recognition (ASR) can be very helpful for speakers who suffer from dysarthria, a neurological disability that damages the control of motor speech articulators. Although a few attempts have been made to apply ASR technologies to sufferers of dysarthria, previous studies show that such ASR systems have not attained an adequate level of performance. In this study, a dysarthric multi-networks speech recognizer (DM-NSR) model is provided using a realization of multi-views multi-learners approach called multi-nets artificial neural networks, which tolerates variability of dysarthric speech. In particular, the DM-NSR model employs several ANNs (as learners) to approximate the likelihood of ASR vocabulary words and to deal with the complexity of dysarthric speech. The proposed DM-NSR approach was presented as both speaker-dependent and speaker-independent paradigms. In order to highlight the performance of the proposed model over legacy models, multi-views single-learner models of the DM-NSRs were also provided and their efficiencies were compared in detail. Moreover, a comparison among the prominent dysarthric ASR methods and the proposed one is provided. The results show that the DM-NSR recorded improved recognition rate by up to 24.67% and the error rate was reduced by up to 8.63% over the reference model.Keywords
Funding Information
- High Impact Research, Ministry of Education Malaysia (UM.C/HIR/625/1/MOE/FCSIT/05)
This publication has 27 references indexed in Scilit:
- An automated framework for software test oracleInformation and Software Technology, 2011
- The TORGO database of acoustic and articulatory speech from speakers with dysarthriaLanguage Resources and Evaluation, 2011
- Speech recognition with artificial neural networksDigital Signal Processing, 2010
- Multiple-view multiple-learner active learningPattern Recognition, 2010
- Automatic speech recognition (ASR) and its use as a tool for assessment or therapy of voice, speech, and language disordersLogopedics Phoniatrics Vocology, 2009
- Experiments with fast Fourier transform, linear predictive and cepstral coefficients in dysarthric speech recognition algorithms using hidden Markov modelIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2005
- An investigation of different degrees of dysarthric speech as input to speaker-adaptive and speaker-dependent recognition systemsAugmentative and Alternative Communication, 2001
- Accuracy of three speech recognition systems: Case study of dysarthric speechAugmentative and Alternative Communication, 2000
- Automatic speech recognition and a review of its functioning with dysarthric speechAugmentative and Alternative Communication, 2000
- Dysarthric speakers' intelligibility and speech characteristics in relation to computer speech recognitionAugmentative and Alternative Communication, 1995