A Groupwise Multilinear Correspondence Optimization for 3D Faces
Authors:
- Timo BolkartTBTimo Bolkart
- Stefanie WuhrerSWStefanie Wuhrer
- 1 December 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3604-3612
Abstract
Multilinear face models are widely used to model the space of human faces with expressions. For databases of 3D human faces of different identities performing multiple expressions, these statistical shape models decouple identity and expression variations. To compute a high-quality multilinear face model, the quality of the registration of the database of 3D face scans used for training is essential. Meanwhile, a multilinear face model can be used as an effective prior to register 3D face scans, which are typically noisy and incomplete. Inspired by the minimum description length approach, we propose the first method to jointly optimize a multilinear model and the registration of the 3D scans used for training. Given an initial registration, our approach fully automatically improves the registration by optimizing an objective function that measures the compactness of the multilinear model, resulting in a sparse model. We choose a continuous representation for each face shape that allows to use a quasi-Newton method in parameter space for optimization. We show that our approach is computationally significantly more efficient and leads to correspondences of higher quality than existing methods based on linear statistical models. This allows us to evaluate our approach on large standard 3D face databases and in the presence of noisy initializations.Keywords
This publication has 21 references indexed in Scilit:
- Using image segmentation for evaluating 3D statistical shape models built with groupwise correspondence optimizationComputer Vision and Image Understanding, 2014
- Most Tensor Problems Are NP-HardJournal of the ACM, 2013
- Automatic landmark annotation and dense correspondence registration for 3D human facial imagesBMC Bioinformatics, 2013
- Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysisImage and Vision Computing, 2012
- Coregistration: Simultaneous Alignment and Modeling of Articulated 3D Shape2012
- A Newton–Grassmann Method for Computing the Best Multilinear Rank-$(r_1,$ $r_2,$ $r_3)$ Approximation of a TensorSIAM Journal on Matrix Analysis and Applications, 2009
- Face transfer with multilinear modelsACM Transactions on Graphics, 2005
- Recovering non-rigid 3D shape from image streams2002
- Multi-Frame Correspondence Estimation Using Subspace ConstraintsInternational Journal of Computer Vision, 2002
- Interactive multi-resolution modeling on arbitrary meshes1998