Emotional Voice Conversion Using Multitask Learning with Text-To-Speech
Authors:
- 1 May 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7774-7778
Abstract
Voice conversion (VC) is a task that alters the voice of a person to suit different styles while conserving the linguistic content. Previous state-of-the-art technology used in VC was based on the sequence-to-sequence (seq2seq) model, which could lose linguistic information. There was an attempt to overcome this problem using textual supervision; however, this required explicit alignment, and therefore the benefit of using seq2seq model was lost. In this study, a voice converter that utilizes multitask learning with text-to-speech (TTS) is presented. By using multitask learning, VC is expected to capture linguistic information and preserve the training stability. This method does not require explicit alignment for capturing abundant text information. Experiments on VC were performed on a male-Korean-emotional-text-speech dataset to convert the neutral voice to emotional voice. It was shown that multitask learning helps to preserve the linguistic content.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Sequence-to-Sequence Acoustic Modeling for Voice ConversionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2019
- Voice Conversion Across Arbitrary Speakers Based on a Single Target-Speaker Utterance2018
- Voice conversion for emotional speech: Rule-based synthesis with degree of emotion controllable in dimensional spaceSpeech Communication, 2018
- Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions2018
- Emotional voice conversion using neural networks with arbitrary scales F0 based on wavelet transformEURASIP Journal on Audio, Speech, and Music Processing, 2017
- Voice conversion using deep Bidirectional Long Short-Term Memory based Recurrent Neural Networks2015
- Spectral Mapping Using Artificial Neural Networks for Voice ConversionIEEE Transactions on Audio, Speech, and Language Processing, 2010
- Voice Conversion Based on Maximum-Likelihood Estimation of Spectral Parameter TrajectoryIEEE Transactions on Audio, Speech, and Language Processing, 2007
- Korean large vocabulary continuous speech recognition with morpheme-based recognition unitsSpeech Communication, 2002
- Voice conversion through vector quantization.Acoustical Science and Technology, 1990