Voice conversion algorithm based on Gaussian mixture model with dynamic frequency warping of STRAIGHT spectrum

Authors:
  • TTT. Toda
    T. Toda
  • HSH. Saruwatari
    H. Saruwatari
  • KSK. Shikano
    K. Shikano

Abstract
ICASSP2001: IEEE International Conference on Acoustics, Speech and Signal Processing, May 7-11, 2001, Salt Lake City, Utah, US.In the voice conversion algorithm based on the Gaussian Mixture Model (GMM) applied to STRAIGHT, quality of converted speech is degraded because the converted spectrum is exceedingly smooth. We propose the GMM-based algorithm with dynamic frequency warping to avoid the over-smoothing. We also propose an addition of the weighted residual spectrum, which is the difference between the GMM-based converted spectrum and the frequency-warped spectrum, to avoid the deterioration of conversion-accuracy on speaker individuality. Results of the evaluation experiments clarify that the converted speech quality is better than that of the GMM-based algorithm, and the conversion-accuracy on speaker individuality is the same as that of the GMM-based algorithm in the proposed method with the properly-weighted residual spectru