Effect of illumination on automatic expression recognition: A novel 3D relightable facial database
Authors:
- 1 March 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 611-618
Abstract
One of the main challenges in facial expression recognition is illumination invariance. Our long-term goal is to develop a system for automatic facial expression recognition that is robust to light variations. In this paper, we introduce a novel 3D Relightable Facial Expression (ICT-3DRFE) database that enables experimentation in the fields of both computer graphics and computer vision. The database contains 3D models for 23 subjects and 15 expressions, as well as photometric information that allow for photorealistic rendering. It is also facial action units annotated, using FACS standards. Using the ICT-3DRFE database we create an image set of different expressions/illuminations to study the effect of illumination on automatic expression recognition. We compared the output scores from automatic recognition with expert FACS annotations and found that they agree when the illumination is uniform. Our results show that the output distribution of the automatic recognition can change significantly with light variations and sometimes causes the discrimination of two different expressions to be diminished. We propose a ratio-based light transfer method, to factor out unwanted illuminations from given images and show that it reduces the effect of illumination on expression recognition.Keywords
This publication has 20 references indexed in Scilit:
- Temporal upsampling of performance geometry using photometric alignmentACM Transactions on Graphics, 2010
- Non-rigid face tracking with enforced convexity and local appearance consistency constraintImage and Vision Computing, 2009
- Automatic Recognition of Facial Actions in Spontaneous ExpressionsJournal of Multimedia, 2006
- The quotient image: Class based recognition and synthesis under varying illumination conditions2003
- Coding facial expressions with Gabor wavelets2002
- Comprehensive database for facial expression analysis2002
- Expressive expression mapping with ratio images2001
- Automatic analysis of facial expressions: the state of the artIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Acquiring the reflectance field of a human face2000
- Rendering synthetic objects into real scenes1998