Modeling Consonant-Vowel Coarticulation for Articulatory Speech Synthesis
Open Access
- 16 April 2013
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 8 (4) , e60603
Abstract
A central challenge for articulatory speech synthesis is the simulation of realistic articulatory movements, which is critical for the generation of highly natural and intelligible speech. This includes modeling coarticulation, i.e., the context-dependent variation of the articulatory and acoustic realization of phonemes, especially of consonants. Here we propose a method to simulate the context-sensitive articulation of consonants in consonant-vowel syllables. To achieve this, the vocal tract target shape of a consonant in the context of a given vowel is derived as the weighted average of three measured and acoustically-optimized reference vocal tract shapes for that consonant in the context of the corner vowels /a/, /i/, and /u/. The weights are determined by mapping the target shape of the given context vowel into the vowel subspace spanned by the corner vowels. The model was applied for the synthesis of consonant-vowel syllables with the consonants /b/, /d/, /g/, /l/, /r/, /m/, /n/ in all combinations with the eight long German vowels. In a perception test, the mean recognition rate for the consonants in the isolated syllables was 82.4%. This demonstrates the potential of the approach for highly intelligible articulatory speech synthesis.Keywords
This publication has 50 references indexed in Scilit:
- Real‐time MRI of speaking at a resolution of 33 ms: Undersampled radial FLASH with nonlinear inverse reconstructionMagnetic Resonance in Medicine, 2012
- Perception of place of articulation for plosives and fricatives in noiseSpeech Communication, 2011
- Vowel and consonant contributions to vocal tract shapeThe Journal of the Acoustical Society of America, 2009
- A three-dimensional articulatory model of the velum and nasopharyngeal wall based on MRI and CT dataThe Journal of the Acoustical Society of America, 2008
- Acoustic PhoneticsThe Journal of the Acoustical Society of America, 2001
- The origin of coarticulation1999
- Toward articulatory-acoustic models for liquid approximants based on MRI and EPG data. Part I. The lateralsThe Journal of the Acoustical Society of America, 1997
- Vowel-consonant-vowel modeling bysuperposition of consonant closure on vowel-to-vowel gesturesJournal of Phonetics, 1995
- Articulatory Phonology: An OverviewPhonetica, 1992
- Numerical Model of CoarticulationThe Journal of the Acoustical Society of America, 1967