Bayesian adaptive learning of the parameters of hidden Markov model for speech recognition
Authors:
- Qiang HuoQHQiang Huo
- Chorkin ChanCCChorkin Chan
- Chin Hui LeeCLChin Hui Lee
Open Access
- 1 January 1995
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Speech and Audio Processing
- Vol. 3 (5) , 334-345
Abstract
A theoretical framework for Bayesian adaptive training of the parameters of a discrete hidden Markov model (DHMM) and of a semi-continuous HMM (SCHMM) with Gaussian mixture state observation densities is presented. In addition to formulating the forward-backward MAP (maximum a posteriori) and the segmental MAP algorithms for estimating the above HMM parameters, a computationally efficient segmental quasi-Bayes algorithm for estimating the state-specific mixture coefficients in SCHMM is developed. For estimating the parameters of the prior densities, a new empirical Bayes method based on the moment estimates is also proposed. The MAP algorithms and the prior parameter specification are directly applicable to training speaker adaptive HMMs. Practical issues related to the use of the proposed techniques for HMM-based speaker adaptation are studied. The proposed MAP algorithms are shown to be effective especially in the cases in which the training or adaptation data are limited.published_or_final_versioKeywords
This publication has 30 references indexed in Scilit:
- Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chainsIEEE Transactions on Speech and Audio Processing, 1994
- Tied mixture continuous parameter modeling for speech recognitionIEEE Transactions on Acoustics, Speech, and Signal Processing, 1990
- The segmental K-means algorithm for estimating parameters of hidden Markov modelsIEEE Transactions on Acoustics, Speech, and Signal Processing, 1990
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- Maximum likelihood estimation for multivariate mixture observations of markov chains (Corresp.)IEEE Transactions on Information Theory, 1986
- On the Convergence Properties of the EM AlgorithmThe Annals of Statistics, 1983
- Maximum likelihood estimation for multivariate observations of Markov sourcesIEEE Transactions on Information Theory, 1982
- An Algorithm for Vector Quantizer DesignIEEE Transactions on Communications, 1980
- A quasi-Bayes unsupervised learning procedure for priors (Corresp.)IEEE Transactions on Information Theory, 1977
- A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov ChainsThe Annals of Mathematical Statistics, 1970