Code-Switching Event Detection by Using a Latent Language Space Model and the Delta-Bayesian Information Criterion
Authors:
- 14 July 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 23 (11) , 1892-1903
Abstract
This paper proposes a new paradigm for code-switching event detection based on latent language space models (LLSMs) and the delta-Bayesian information criterion (ΔBIC). A phone-based Mandarin-English speech recognizer was first employed for obtaining the senone sequence of a speech utterance. For each senone, acoustic features and the posterior probability of the articulatory features (AFs) were extracted and applied to an eigenspace transformation, based on principal component analysis (PCA). Latent semantic analysis (LSA) was then adopted for constructing a matrix to model the importance of each principal component in the eigenspace for the senones and AFs in each language. The spatial relationships among the senones (or AFs) represented by the PCA-transformed eigenvalues in the LSA-based matrix were employed to construct an LLSM for characterizing a language. In code-switching event detection, the language likelihood between the input speech LLSM and each of the language-dependent LLSMs was estimated. The Euclidian-distance-based similarities and cosine-angle-distance-based similarities were adopted for estimating the language likelihood for senones and AFs. The ΔBIC was then used for estimating the language transition score for each hypothesized code-switching event. Finally, the dynamic programming algorithm was employed for obtaining the most likely code-switching language sequence. The proposed approach was evaluated using a Mandarin-English code-switching speech database and outperformed other conventional methods. A duration accuracy of 72.45% can be obtained from the proposed system with optimized parameters.Keywords
Funding Information
- National Science Council (NSC102-2221-E-006-094-MY3)
This publication has 25 references indexed in Scilit:
- Articulatory feature-based gender factor minimization in automatic speech recognition2013
- Automatic speech recognition using articulatory features from subject-independent acoustic-to-articulatory inversionThe Journal of the Acoustical Society of America, 2011
- Toward a detector-based universal phone recognizerInternational Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2008
- Automatic Language Identification with Discriminative Language Characterization Based on SVMIEICE Transactions on Information and Systems, 2008
- Support vector machines for speaker and language recognitionComputer Speech & Language, 2006
- Multilingual articulatory features2003
- Discriminative training of Gaussian mixture bigram models with application to Chinese dialect identificationSpeech Communication, 2002
- Comparison of four approaches to automatic language identification of telephone speechIEEE Transactions on Speech and Audio Processing, 1996
- The SPHINX-II speech recognition system: an overviewComputer Speech & Language, 1993
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974