Subunits Inference and Lexicon Development Based on Pairwise Comparison of Utterances and Signs
Open Access
- 26 September 2019
- journal article
- research article
- Published by MDPI AG in Information
- Vol. 10 (10) , 298
Abstract
Communication languages convey information through the use of a set of symbols or units. Typically, this unit is word. When developing language technologies, as words in a language do not have the same prior probability, there may not be sufficient training data for each word to model. Furthermore, the training data may not cover all possible words in the language. Due to these data sparsity and word unit coverage issues, language technologies employ modeling of subword units or subunits, which are based on prior linguistic knowledge. For instance, development of speech technologies such as automatic speech recognition system presume that there exists a phonetic dictionary or at least a writing system for the target language. Such knowledge is not available for all languages in the world. In that direction, this article develops a hidden Markov model-based abstract methodology to extract subword units given only pairwise comparison between utterances (or realizations of words in the mode of communication), i.e., whether two utterances correspond to the same word or not. We validate the proposed methodology through investigations on spoken language and sign language. In the case of spoken language, we demonstrate that the proposed methodology can lead up to discovery of phone set and development of phonetic dictionary. In the case of sign language, we demonstrate how hand movement information can be effectively modeled for sign language processing and synthesized back to gain insight about the derived subunits.Keywords
Funding Information
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (CRSII2_160811)
This publication has 49 references indexed in Scilit:
- Towards weakly supervised acoustic subword unit discovery and lexicon development using hidden Markov modelsSpeech Communication, 2018
- The role of syllables in sign language productionFrontiers in Psychology, 2014
- Sign Language Recognition2011
- Letter-to-Sound Pronunciation Prediction Using Conditional Random FieldsIEEE Signal Processing Letters, 2010
- Joint-sequence models for grapheme-to-phoneme conversionSpeech Communication, 2008
- Unsupervised Pattern Discovery in SpeechIEEE Transactions on Audio, Speech, and Language Processing, 2007
- Automatic generation of subword units for speech recognition systemsIEEE Transactions on Speech and Audio Processing, 2002
- Joint lexicon, acoustic unit inventory and model designSpeech Communication, 1999
- The Linguistics of British Sign Language1999
- PRONOUNCE: a program for pronunciation by analogyComputer Speech & Language, 1991