Resynthesizing facial animation through 3D model-based tracking
Authors:
- 1 January 1999
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 143-150 vol.1
Abstract
Given video footage of a person's face, we present new techniques to automatically recover the face position and the facial expression from each frame in the video sequence. A 3D face model is fitted to each frame using a continuous optimization technique. Our model is based on a set of 3D face models that are linearly combined using 3D morphing. Our method has the advantages over previous techniques of fitting directly a realistic 3-dimensional face model and of recovering parameters that can be used directly in an animation system. We also explore many applications, including performance-driven animation (applying the recovered position and expression of the face to a synthetic character to produce an animation that mimics the input video), relighting the face, varying the camera position, and adding facial ornaments such as tattoos and scars.Keywords
This publication has 12 references indexed in Scilit:
- Making faces1998
- Interpreting face images using active appearance models1998
- Synthesizing realistic facial expressions from photographs1998
- Coding, analysis, interpretation, and recognition of facial expressionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Video Rewrite1997
- Real-time tracking of image regions with changes in geometry and illumination1996
- Analysis and synthesis of facial image sequences in model-based image codingIEEE Transactions on Circuits and Systems for Video Technology, 1994
- 3-D motion estimation in model-based facial image codingIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993
- Analysis and synthesis of facial image sequences using physical and anatomical modelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993
- Model-based analysis synthesis image coding (MBASIC) system for a person's faceSignal Processing: Image Communication, 1989