A blendshape model for mapping facial motions to an android
Authors:
- 1 October 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21530858,p. 542-547
Abstract
An important part of natural, and therefore effective, communication is facial motion. The android Repliee Q2 should therefore display realistic facial motion. In computer graphics animation, such motion is created by mapping human motion to the animated character. This paper proposes a method for mapping human facial motion to the android. This is done using a linear model of the android, based on blendshape models used in computer graphics. The model is derived from motion capture of the android and therefore also models the android's physical limitations. The paper shows that the blendshape method can be successfully applied to the android. Also, it is shown that a linear model is sufficient for representing android facial motion, which means control can be very straightforward. Measurements of the produced motion identify the physical limitations of the android and allow identifying the main areas for improvement of the android design.Keywords
This publication has 12 references indexed in Scilit:
- Android science: conscious and subconscious recognitionConnection Science, 2006
- Facial motion retargeting2006
- Generating natural motion in an android by mapping human motion2005
- Matching robot appearance and behavior to tasks to improve human-robot cooperation2004
- Realization of realistic and rich facial expressions by face robot2004
- Controlling a marionette with human motion capture data2004
- Adapting human motion for the control of a humanoid robot2003
- Real-time speech-driven face animation with expressions using neural networksIEEE Transactions on Neural Networks, 2002
- Audio-visual integration in multimodal communicationProceedings of the IEEE, 1998
- Hearing lips and seeing voicesNature, 1976