Morphable Face Models - An Open Framework
Authors:
- Thomas GerigTGThomas Gerig
- Andreas Morel-ForsterAMAndreas Morel-Forster
- Clemens BlumerCBClemens Blumer
- Bernhard EggerBEBernhard Egger
- Marcel LuthiMLMarcel Luthi
- Sandro SchoenbornSSSandro Schoenborn
- Thomas VetterTVThomas Vetter
- 1 May 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 75-82
Abstract
In this paper, we present a novel open-source pipeline for face registration based on Gaussian processes as well as an application to face image analysis. Non-rigid registration of faces is significant for many applications in computer vision, such as the construction of 3D Morphable face models (3DMMs). Gaussian Process Morphable Models (GPMMs) unify a variety of non-rigid deformation models with B-splines and PCA models as examples. GPMM separate problem specific requirements from the registration algorithm by incorporating domain-specific adaptions as a prior model. The novelties of this paper are the following: (i) We present a strategy and modeling technique for face registration that considers symmetry, multi-scale and spatially-varying details. The registration is applied to neutral faces and facial expressions. (ii) We release an open-source software framework for registration model-building demonstrated on the publicly available BU3D-FE database. The released pipeline also contains an implementation of an Analysis-by-Synthesis model adaption of 2D face images, tested on the Multi-PIE and LFW database. This enables the community to reproduce, evaluate and compare the individual steps of registration to model-building and 3D/2D model fitting. (iii) Along with the framework release, we publish a new version of the Basel Face Model (BFM-2017) with an improved age distribution and an additional facial expression model.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Fully automatic expression-invariant face correspondenceMachine Vision and Applications, 2013
- Human face shape analysis under spherical harmonics illumination considering self occlusion2013
- Multi-PIEImage and Vision Computing, 2010
- A Statistical Model of Human Pose and Body ShapeComputer Graphics Forum, 2009
- Multiscale kernelsAdvances in Computational Mathematics, 2006
- The space of human body shapesACM Transactions on Graphics, 2003
- Lambertian reflectance and linear subspacesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- A morphable model for the synthesis of 3D faces1999
- A method for registration of 3-D shapesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
- Updating Quasi-Newton Matrices with Limited StorageMathematics of Computation, 1980