Speech-to-Singing Synthesis: Converting Speaking Voices to Singing Voices by Controlling Acoustic Features Unique to Singing Voices
- 1 October 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 19311168,p. 215-218
Abstract
This paper describes a speech-to-singing synthesis system that can synthesize a singing voice, given a speaking voice reading the lyrics of a song and its musical score. The system is based on the speech manipulation system STRAIGHT and comprises three models controlling three acoustic features unique to singing voices: the fundamental frequency (F0), phoneme duration, and spectrum. Given the musical score and its tempo, the F0 control model generates the F0 contour of the singing voice by controlling four types of F0 fluctuations: overshoot, vibrato, preparation, and fine fluctuation. The duration control model lengthens the duration of each phoneme in the speaking voice by considering the duration of its musical note. The spectral control model converts the spectral envelope of the speaking voice into that of the singing voice by controlling both the singing formant and the amplitude modulation of formants in synchronization with vibrato. Experimental results show that the proposed system can convert speaking voices into singing voices whose naturalness is almost the same as actual singing voices.Keywords
This publication has 7 references indexed in Scilit:
- Synthesis of the Singing Voice by Performance Sampling and Spectral ModelsIEEE Signal Processing Magazine, 2007
- Development of an F0 control model based on F0 dynamic characteristics for singing-voice synthesisSpeech Communication, 2005
- Prosodic modeling of nagauta singing and its evaluation2004
- Restructuring speech representations using a pitch-adaptive time–frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in soundsSpeech Communication, 1999
- Acoustic variability in vibrato and its perceptual significanceJournal of Voice, 1987
- Articulatory interpretation of the “singing formant”The Journal of the Acoustical Society of America, 1974
- Frequency, Amplitude, and Waveform Modulation in the Vocal VibratoThe Journal of the Acoustical Society of America, 1971