Multimodal adapted robot behavior synthesis within a narrative human-robot interaction
Authors:
- 1 September 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2986-2993
Abstract
In human-human interaction, three modalities of communication (i.e., verbal, nonverbal, and paraverbal) are naturally coordinated so as to enhance the meaning of the conveyed message. In this paper, we try to create a similar coordination between these modalities of communication in order to make the robot behave as naturally as possible. The proposed system uses a group of videos in order to elicit specific target emotions in a human user, upon which interactive narratives will start (i.e., interactive discussions between the participant and the robot around each video's content). During each interaction experiment, the humanoid expressive ALICE robot engages and generates an adapted multimodal behavior to the emotional content of the projected video using speech, head-arm metaphoric gestures, and/or facial expressions. The interactive speech of the robot is synthesized using Mary-TTS (text to speech toolkit), which is used - in parallel - to generate adapted head-arm gestures [1]. This synthesized multimodal robot behavior is evaluated by the interacting human at the end of each emotion-eliciting experiment. The obtained results validate the positive effect of the generated robot behavior multimodality on interaction.Keywords
This publication has 31 references indexed in Scilit:
- Compound facial expressions of emotionProceedings of the National Academy of Sciences, 2014
- Design of the robot-cub (iCub) head2006
- BRIEF REPORTCognition and Emotion, 2005
- iCat2005
- The German Text-to-Speech Synthesis System MARY: A Tool for Research, Development and TeachingInternational Journal of Speech Technology, 2003
- Speech Database Design for a Concatenative Text-to-Speech Synthesis System for Individuals with Communication DisordersInternational Journal of Speech Technology, 2003
- Toward sociable robotsRobotics and Autonomous Systems, 2003
- Making faces: Creating three-dimensional parameterized models of facial expressionBehavior Research Methods, Instruments, & Computers, 2001
- SSML: A speech synthesis markup languageSpeech Communication, 1997
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989