Augmenting physical avatars using projector-based illumination
Authors:
Open Access
- 1 November 2013
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 32 (6) , 1-10
Abstract
Animated animatronic figures are a unique way to give physical presence to a character. However, their movement and expressions are often limited due to mechanical constraints. In this paper, we propose a complete process for augmenting physical avatars using projector-based illumination, significantly increasing their expressiveness. Given an input animation, the system decomposes the motion into low-frequency motion that can be physically reproduced by the animatronic head and high-frequency details that are added using projected shading. At the core is a spatio-temporal optimization process that compresses the motion in gradient space, ensuring faithful motion replay while respecting the physical limitations of the system. We also propose a complete multi-camera and projection system, including a novel defocused projection and subsurface scattering compensation scheme. The result of our system is a highly expressive physical avatar that features facial details and motion otherwise unattainable due to physical constraints.Keywords
This publication has 34 references indexed in Scilit:
- Spacetime expression cloning for blendshapesACM Transactions on Graphics, 2012
- Fast high-resolution appearance editing using superimposed projectionsACM Transactions on Graphics, 2012
- Perceptually Based Appearance Modification for Compliant Appearance EditingComputer Graphics Forum, 2011
- High-quality passive facial performance capture using anchor framesACM Transactions on Graphics, 2011
- A quantized-diffusion model for rendering translucent materialsACM Transactions on Graphics, 2011
- Example-based facial riggingACM Transactions on Graphics, 2010
- Coded aperture projectionACM Transactions on Graphics, 2010
- Projection defocus analysis for scene capture and image displayACM Transactions on Graphics, 2006
- Analysis of human faces using a measurement-based skin reflectance modelACM Transactions on Graphics, 2006
- A flexible new technique for camera calibrationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000