Learning Formation of Physically-Based Face Attributes
Authors:
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3407-3416
Abstract
Based on a combined data set of 4000 high resolution facial scans, we introduce a non-linear morphable face model, capable of producing multifarious face geometry of pore-level resolution, coupled with material attributes for use in physically-based rendering. We aim to maximize the variety of the participant’s face identities, while increasing the robustness of correspondence between unique components, including middle-frequency geometry, albedo maps, specular intensity maps and high-frequency displacement details. Our deep learning based generative model learns to correlate albedo and geometry, which ensures the anatomical correctness of the generated assets. We demonstrate potential use of our generative model for novel identity generation, model fitting, interpolation, animation, high fidelity data visualization, and low-to-high resolution data domain transferring. We hope the release of this generative model will encourage further cooperation between all graphics, vision, and data focused professionals, while demonstrating the cumulative value of every individual’s complete biometric profile.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- Real-time high-fidelity facial performance captureACM Transactions on Graphics, 2015
- Automatic acquisition of high-fidelity facial performances using monocular videosACM Transactions on Graphics, 2014
- Sparse localized deformation componentsACM Transactions on Graphics, 2013
- Reconstructing detailed dynamic face geometry from monocular videoACM Transactions on Graphics, 2013
- Multiview face capture using polarized spherical gradient illuminationACM Transactions on Graphics, 2011
- High-quality passive facial performance capture using anchor framesACM Transactions on Graphics, 2011
- Non-rigid dense correspondence with applications for image enhancementACM Transactions on Graphics, 2011
- High-quality single-shot capture of facial geometryACM Transactions on Graphics, 2010
- Global Correspondence Optimization for Non‐Rigid Registration of Depth ScansComputer Graphics Forum, 2008
- Face transfer with multilinear modelsACM Transactions on Graphics, 2005