VocaListener and VocaWatcher: Imitating a human singer by using signal processing
- 1 March 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15206149,p. 5393-5396
Abstract
In this paper, we describe three singing information processing systems, VocaListener, VocaListener2, and VocaWatcher, that imitate singing expressions of the voice and face of a human singer. VocaListener can synthesize natural singing voices by analyzing and imitating the pitch and dynamics of the human singing. VocaListener2 imitates temporal timbre changes in addition to the pitch and dynamics. In synchronization with the synthesized singing voices, VocaWatcher can generate realistic facial motions of a humanoid robot, the HRP-4C, by analyzing and imitating facial motions of a human singing that are recorded by a single video camera. These systems that focus on “imitation” are not only promising for representing human-like naturalness, but also useful for providing intuitive control means.Keywords
This publication has 18 references indexed in Scilit:
- VocaWatcher: Natural singing motion generator for a humanoid robot2011
- Data-driven emotion conversion in spoken EnglishSpeech Communication, 2009
- HMM-Based Style Control for Expressive Speech Synthesis with Arbitrary Speaker's Voice Using Model AdaptationIEICE Transactions on Information and Systems, 2009
- Facial behaviour mapping—From video footage to a robot headRobotics and Autonomous Systems, 2008
- Voice Conversion Based on Maximum-Likelihood Estimation of Spectral Parameter TrajectoryIEEE Transactions on Audio, Speech, and Language Processing, 2007
- A blendshape model for mapping facial motions to an android2007
- Speech-to-Singing Synthesis: Converting Speaking Voices to Singing Voices by Controlling Acoustic Features Unique to Singing Voices2007
- Synthesis of the Singing Voice by Performance Sampling and Spectral ModelsIEEE Signal Processing Magazine, 2007
- Development of a new anthropomorphic flutist robot WF-42004
- The robot musician ‘wabot-2’ (waseda robot-2)Robotics, 1987