Analysis and generation of laughter motions, and evaluation in an android robot
Open Access
- 25 January 2019
- journal article
- research article
- Published by Emerald Publishing in APSIPA Transactions on Signal and Information Processing
- Vol. 8 (1)
Abstract
Laughter commonly occurs in daily interactions, and is not only simply related to funny situations, but also to expressing some type of attitudes, having important social functions in communication. The background of the present work is to generate natural motions in a humanoid robot, so that miscommunication might be caused if there is mismatching between audio and visual modalities, especially in laughter events. In the present work, we used a multimodal dialogue database, and analyzed facial, head, and body motion during laughing speech. Based on the analysis results of human behaviors during laughing speech, we proposed a motion generation method given the speech signal and the laughing speech intervals. Subjective experiments were conducted using our android robot by generating five different motion types, considering several modalities. Evaluation results showed the effectiveness of controlling different parts of the face, head, and upper body (eyelid narrowing, lip corner/cheek raising, eye blinking, head motion, and upper body motion control).Keywords
This publication has 16 references indexed in Scilit:
- Laughter Research: A Review of the ILHAIRE Project2016
- Modeling Emotions in Robotic Socially Believable Behaving Systems2016
- Rhythmic Body Movements of Laughter2014
- GENERATION OF NODDING, HEAD TILTING AND GAZING FOR HUMAN–ROBOT SPEECH INTERACTIONInternational Journal of Humanoid Robotics, 2013
- Evaluation of formant-based lip motion generation in tele-operated humanoid robots2012
- Smiling virtual agent in social contextCognitive Processing, 2011
- Head motion during dialogue speech and nod timing control in humanoid robots2010
- Humor and Laughter May Influence Health: III. Laughter and Health OutcomesEvidence-Based Complementary and Alternative Medicine, 2007
- Emotion and sociable humanoid robotsInternational Journal of Human-Computer Studies, 2003
- Linking facial animation, head motion and speech acousticsJournal of Phonetics, 2002