Advances in Behavioral Science Using Automated Facial Image Analysis and Synthesis [Social Sciences
- 18 October 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Magazine
- Vol. 27 (10535888) , 128-133
Abstract
The face conveys information about a person's age, sex, background, and identity; what they are feeling, thinking, or likely to do next. Facial expression regulates face-to-face interactions, indicates reciprocity and interpersonal attraction or repulsion, and enables intersubjectivity between members of different cultures. Facial expression indexes neurological and psychiatric functioning and reveals personality and socioemotional development. Not surprisingly, the face has been of keen interest to behavioral scientists. About 15 years ago, computer scientists became increasingly interested in the use of computer vision and graphics to automatically analyze and synthesize facial expression. This effort was made possible in part by the development in psychology of detailed coding systems for describing facial actions and their relation to basic emotions, that is, emotions that are interpreted similarly in diverse cultures. The most detailed of these systems, the Facial Action Coding System (FACS), informed the development of the MPEG-4 facial animation parameters for video transmission and enabled progress toward automated measurement and synthesis of facial actions for research in affective computing, social signal processing, and behavioral science. This article reports key advances in behavioral science that are becoming possible through these developments. Before beginning, automated facial image analysis and synthesis (AFAS) is briefly described.Keywords
This publication has 12 references indexed in Scilit:
- Registration Invariant Representations for Expression Detection2010
- Spontaneous facial expression in a small group can be automatically measured: An initial demonstrationBehavior Research Methods, 2010
- Effects of damping head movement and facial expression in dyadic conversation using real–time facial expression tracking and synthesized avatarsPhilosophical Transactions of the Royal Society B: Biological Sciences, 2009
- The painful face – Pain expression recognition using active appearance modelsImage and Vision Computing, 2009
- Efficient constrained local model fitting for non-rigid face alignmentImage and Vision Computing, 2009
- Automatically detecting pain using facial actions2009
- Detecting depression from facial actions and vocal prosody2009
- All Smiles are Not Created Equal: Morphology and Timing of Smiles Perceived as Amused, Polite, and Embarrassed/NervousJournal of Nonverbal Behavior, 2008
- 2D vs. 3D Deformable Face Models: Representational Power, Construction, and Real-Time FittingInternational Journal of Computer Vision, 2007
- Active appearance modelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001