ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representations
Authors:
- 1 June 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 20311-20320
Abstract
Precise representations of 3D faces are beneficial to various computer vision and graphics applications. Due to the data discretization and model linearity, however, it remains challenging to capture accurate identity and expression clues in current studies. This paper presents a novel 3D morphable face model, namely ImFace, to learn a nonlinear and continuous space with implicit neural representations. It builds two explicitly disentangled deformation fields to model complex shapes associated with identities and expressions, respectively, and designs an improved learning strategy to extend embeddings of expressions to allow more diverse changes. We further introduce a Neural Blend-Field to learn sophisticated details by adaptively blending a series of local fields. In addition to ImFace, an effective pre-processing pipeline is proposed to address the issue of watertight input requirement in implicit representations, enabling them to work with common facial surfaces for the first time. Extensive experiments are performed to demonstrate the superiority of ImFace.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62022011)
- Natural Science Foundation of Beijing Municipality (4222049)
This publication has 42 references indexed in Scilit:
- Efficient GPU path rendering using scanline rasterizationACM Transactions on Graphics, 2016
- Face Recognition Using a Unified 3D Morphable Model2016
- A Groupwise Multilinear Correspondence Optimization for 3D Faces2015
- Describing Crouzon and Pfeiffer syndrome based on principal component analysisJournal of Cranio-Maxillofacial Surgery, 2015
- Inverse Rendering of Faces with a 3D Morphable ModelIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- A FACS valid 3D dynamic action unit database with applications to 3D dynamic morphable facial modeling2011
- Face recognition based on fitting a 3D morphable modelIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- A morphable model for the synthesis of 3D faces1999
- Fast, Minimum Storage Ray-Triangle IntersectionJournal of Graphics Tools, 1997
- Two algorithms for constructing a Delaunay triangulationInternational Journal of Parallel Programming, 1980