Specifying and animating facial signals for discourse in embodied conversational agents
Authors:
- Doug DeCarloDDDoug DeCarlo
- Matthew StoneMSMatthew Stone
- Corey RevillaCRCorey Revilla
- Jennifer J. VendittiJVJennifer J. Venditti
- 8 March 2004
- journal article
- research article
- Published by Wiley in Computer Animation and Virtual Worlds
- Vol. 15 (1) , 27-38
Abstract
People highlight the intended interpretation of their utterances within a larger discourse by a diverse set of non‐verbal signals. These signals represent a key challenge for animated conversational agents because they are pervasive, variable, and need to be coordinated judiciously in an effective contribution to conversation. In this paper, we describe a freely available cross‐platform real‐time facial animation system,RUTH, that animates such high‐level signals in synchrony with speech and lip movements.RUTHadopts an open, layered architecture in which fine‐grained features of the animation can be derived by rule from inferred linguistic structure, allowing us to useRUTH, in conjunction with annotation of observed discourse, to investigate the meaningful high‐level elements of conversational facial movement for American English speakers. Copyright © 2004 John Wiley & Sons, Ltd.Keywords
This publication has 35 references indexed in Scilit:
- Subtleties of facial expressions in embodied agentsThe Journal of Visualization and Computer Animation, 2002
- Visible Acts of MeaningJournal of Language and Social Psychology, 2000
- Rules for the generation of ToBI-based American English intonationSpeech Communication, 1999
- Generating Facial Expressions for SpeechCognitive Science, 1996
- Pitch accent in context predicting intonational prominence from textArtificial Intelligence, 1993
- Physically‐based facial modelling, analysis, and animationThe Journal of Visualization and Computer Animation, 1990
- Speech as Audible Gestures1990
- A muscle model for animation three-dimensional facial expressionACM SIGGRAPH Computer Graphics, 1987
- Evidence for the independent function of intonation contour type, voice quality, and F0 range in signaling speaker affectThe Journal of the Acoustical Society of America, 1985
- ELIZA—a computer program for the study of natural language communication between man and machineCommunications of the ACM, 1966