Muscular Movement Model-Based Automatic 3D/4D Facial Expression Recognition

Authors:
Publisher website
Google Scholar
Abstract
Facial expression is an important channel for human nonverbal communication. This paper presents a novel and effective approach to automatic 3D/4D facial expression recognition based on the muscular movement model (MMM). In contrast to most of existing methods, the MMM deals with such an issue in the viewpoint of anatomy. It first automatically segments the input 3D face (frame) by localizing the corresponding points within each muscular region of the reference using iterative closest normal point. A set of features with multiple differential quantities, including coordinate, normal, values, are then extracted to describe the geometry deformation of each segmented region. Meanwhile, we analyze the importance of these muscular areas, and a score level fusion strategy is exploited to optimize their weights by the genetic algorithm in the learning step. The support vector machine and the hidden Markov model are finally used to predict the expression label in 3D and 4D, respectively. The experiments are conducted on the BU-3DFE and BU-4DFE databases, and the results achieved clearly demonstrate the effectiveness of the proposed method.
Funding Information
  • Hong Kong, Macao, and Taiwan Science and Technology Cooperation Program of China (L2015TGA9004)
  • National Natural Science Foundation of China (61540048, 61273263, 61421003)
  • Specialized Research Fund for the Doctoral Program of Higher Education (20121102120016)
  • French Research Agency
  • l’Agence Nationale de Recherche (ANR)
  • Jemime (ANR-13-CORD-0004-02)
  • Fundamental Research Funds for the Central Universities

This publication has 43 references indexed in Scilit: