Transporting Deformations of Face Emotions in the Shape Spaces: A Comparison of Different Approaches
Authors:
Open Access
- 18 May 2021
- journal article
- research article
- Published by Springer Nature in Journal of Mathematical Imaging and Vision
- Vol. 63 (7) , 875-893
Abstract
Studying the changes of shape is a common concern in many scientific fields. We address here two problems: (1) quantifying the deformation between two given shapes and (2) transporting this deformation to morph a third shape. These operations can be done with or without point correspondence, depending on the availability of a surface matching algorithm, and on the type of mathematical procedure adopted. In computer vision, the re-targeting of emotions mapped on faces is a common application. We contrast here four different methods used for transporting the deformation toward a target once it was estimated upon the matching of two shapes. These methods come from very different fields such as computational anatomy, computer vision and biology. We used the large diffeomorphic deformation metric mapping and thin plate spline, in order to estimate deformations in a deformational trajectory of a human face experiencing different emotions. Then we use naive transport (NT), linear shift (LS), direct transport (DT) and fanning scheme (FS) to transport the estimated deformations toward four alien faces constituted by 240 homologous points and identifying a triangulation structure of 416 triangles. We used both local and global criteria for evaluating the performance of the 4 methods, e.g., the maintenance of the original deformation. We found DT, LS and FS very effective in recovering the original deformation while NT fails under several aspects in transporting the shape change. As the best method may differ depending on the application, we recommend carefully testing different methods in order to choose the best one for any specific application.Keywords
Funding Information
- Università degli Studi Roma Tre
This publication has 44 references indexed in Scilit:
- Geodesics, Parallel Transport & One-Parameter Subgroups for Diffeomorphic Image RegistrationInternational Journal of Computer Vision, 2012
- Comparison of the endocranial ontogenies between chimpanzees and bonobos via temporal regression and spatiotemporal registrationJournal of Human Evolution, 2012
- Time sequence diffeomorphic metric mapping and parallel transport track time-dependent shape changesNeuroImage, 2009
- Testing evolutionary stasis and trends in first lower molar shape of extinct Italian populations of Terricola savii (Arvicolidae, Rodentia) by means of geometric morphometricsJournal of Evolutionary Biology, 2008
- The emerging discipline of Computational Functional AnatomyNeuroImage, 2008
- Shape-space smoothing splines for planar landmark dataBiometrika, 2007
- Detection of Plio-Quaternary large mammal communities of Italy. An integration of fossil faunas biochronology and similarityQuaternary Science Reviews, 2006
- UNROLLING SHAPE CURVESJournal of the London Mathematical Society, 2003
- Landmark matching via large deformation diffeomorphismsIEEE Transactions on Image Processing, 2000
- Principal warps: thin-plate splines and the decomposition of deformationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1989