Synthesis of Facial Expressions in Photographs
Open Access
- 28 January 2019
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 51 (6) , 1-35
Abstract
The synthesis of facial expressions has applicationsin areas such as interactive games, biometrics systems, and training of people with disorders, among others. Although this is an area relatively well explored in the literature, there are no recent studies proposing to systematize an overview of research in the area. This systematic review analyzes the approaches to the synthesis of facial expressions in photographs, as well as important aspects of the synthesis process, such as preprocessing techniques, databases, and evaluation metrics. Forty-eight studies from three different scientific databases were analyzed. From these studies, we established an overview of the process, including all the stages used to synthesize expressions in facial images. We also analyze important aspects involved in these stages such as methods and techniques of each stage, databases, and evaluation metrics. We observed that machine learning approaches are the most widely used to synthesize expressions. Landmark identification, deformation, mapping, fusion, and training are common tasks considered in the approaches. We also found that few studies used metrics to evaluate the results, and most studies used public databases. Although the studies analyzed generated consistent and realistic results while preserving the identity of the subject, there are still research themes to be exploited.Keywords
Funding Information
- INCT-MACC
- CAPES (001)
This publication has 81 references indexed in Scilit:
- A realistic dynamic facial expression transfer methodNeurocomputing, 2012
- Brain Mapping Biomarkers of Socio-Emotional Processing in SchizophreniaSchizophrenia Bulletin, 2011
- Multi-PIEImage and Vision Computing, 2010
- Effects of damping head movement and facial expression in dyadic conversation using real–time facial expression tracking and synthesized avatarsPhilosophical Transactions of the Royal Society B: Biological Sciences, 2009
- Visio-lizationACM Transactions on Graphics, 2009
- Affective interaction based on person-independent facial expression spaceNeurocomputing, 2008
- Photo-realistic facial expression synthesisImage and Vision Computing, 2005
- Emotional facial expression model buildingPattern Recognition Letters, 2003
- An experimental comparison of usage-based and checklist-based readingIEEE Transactions on Software Engineering, 2003
- Measuring facial movementJournal of Nonverbal Behavior, 1976