Robust Speaker-Adaptive HMM-Based Text-to-Speech Synthesis
- 30 June 2009
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech, and Language Processing
- Vol. 17 (6) , 1208-1230
Abstract
This paper describes a speaker-adaptive HMM-based speech synthesis system. The new system, called ldquoHTS-2007,rdquo employs speaker adaptation (CSMAPLR+MAP), feature-space adaptive training, mixed-gender modeling, and full-covariance modeling using CSMAPLR transforms, in addition to several other techniques that have proved effective in our previous systems. Subjective evaluation results show that the new system generates significantly better quality synthetic speech than speaker-dependent approaches with realistic amounts of speech data, and that it bears comparison with speaker-dependent approaches even when large amounts of speech data are available. In addition, a comparison study with several speech synthesis techniques shows the new system is very robust: It is able to build voices from less-than-ideal speech data and synthesize good-quality speech even for out-of-domain sentences.Keywords
This publication has 42 references indexed in Scilit:
- The Nitech-NAIST HMM-Based Speech Synthesis System for the Blizzard Challenge 2006IEICE Transactions on Information and Systems, 2008
- State Duration Modeling for HMM-Based Speech SynthesisIEICE Transactions on Information and Systems, 2007
- Details of the Nitech HMM-Based Speech Synthesis System for the Blizzard Challenge 2005IEICE Transactions on Information and Systems, 2007
- Acoustic Modeling of Speaking Styles and Emotional Expressions in HMM-Based Speech SynthesisIEICE Transactions on Information and Systems, 2005
- Speaker adaptation of pitch and spectrum for HMM‐based speech synthesisSystems and Computers in Japan, 2004
- Semi-tied covariance matrices for hidden Markov modelsIEEE Transactions on Speech and Audio Processing, 1999
- Restructuring speech representations using a pitch-adaptive time–frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in soundsSpeech Communication, 1999
- Speaker adaptation using combined transformation and Bayesian methodsIEEE Transactions on Speech and Audio Processing, 1996
- A mixed excitation LPC vocoder model for low bit rate speech codingIEEE Transactions on Speech and Audio Processing, 1995
- Speaker adaptation using constrained estimation of Gaussian mixturesIEEE Transactions on Speech and Audio Processing, 1995