Recent Advances in Facial Appearance Capture
Authors:
- 1 May 2015
- journal article
- Published by Wiley in Computer Graphics Forum
- Vol. 34 (2) , 709-733
Abstract
Facial appearance capture is now firmly established within academic research and used extensively across various application domains, perhaps most prominently in the entertainment industry through the design of virtual characters in video games and films. While significant progress has occurred over the last two decades, no single survey currently exists that discusses the similarities, differences, and practical considerations of the available appearance capture techniques as applied to human faces. A central difficulty of facial appearance capture is the way light interacts with skin—which has a complex multi‐layered structure—and the interactions that occur below the skin surface can, by definition, only be observed indirectly. In this report, we distinguish between two broad strategies for dealing with this complexity. “Image‐based methods” try to exhaustively capture the exact face appearance under different lighting and viewing conditions, and then render the face through weighted image combinations. “Parametric methods” instead fit the captured reflectance data to some parametric appearance model used during rendering, allowing for a more lightweight and flexible representation but at the cost of potentially increased rendering complexity or inexact reproduction. The goal of this report is to provide an overview that can guide practitioners and researchers in assessing the tradeoffs between current approaches and identifying directions for future advances in facial appearance capture.Keywords
This publication has 89 references indexed in Scilit:
- High-quality passive facial performance capture using anchor framesACM Transactions on Graphics, 2011
- Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisitionACM Transactions on Graphics, 2011
- A quantized-diffusion model for rendering translucent materialsACM Transactions on Graphics, 2011
- A layered, heterogeneous reflectance model for acquiring and rendering human skinACM Transactions on Graphics, 2008
- Hair photoboothACM Transactions on Graphics, 2008
- A Biophysically‐Based Spectral Model of Light Interaction with Human SkinComputer Graphics Forum, 2004
- Estimation-theoretic approach to dynamic range enhancement using multiple exposuresJournal of Electronic Imaging, 2003
- A comprehensive physical model for light reflectionACM SIGGRAPH Computer Graphics, 1991
- Models of light reflection for computer synthesized picturesACM SIGGRAPH Computer Graphics, 1977
- Theory for Off-Specular Reflection From Roughened Surfaces*Journal of the Optical Society of America, 1967