Emotion-Specific Facial Activation Maps Based on Infrared Thermal Image Sequences
Open Access
- 2 April 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 48046-48052
Abstract
Research on emotion recognition has recently started to gain increased attention. Inner emotions or thought activity can be determined by analyzing facial expression, behavioral responses, audio, and physiological signals. Facial expression is now recognized as an important form of non-verbal interaction. In this paper, emotion-specific activation maps were constructed to establish infrared thermal facial image sequences as an alternative approach to the determination of the correlation between emotional triggers and changes in facial temperature. During the testing process, data stored in the International Affective Picture System were used to create emotional clips that triggered three different types of emotion in the subjects, and their infrared thermal facial image sequences were simultaneously recorded. For processing, an image calibration protocol was first employed to reduce the variance produced by irregular micro-shifts in the faces of the subjects, followed by independent component analysis and statistical analysis protocols to create the facial emotional activation maps. The test results showed that the problem of selecting local regions when analyzing frame temperature had been resolved. The emotion-specific facial activation maps provide visualized results that facilitate the observation and understanding of information.Keywords
Funding Information
- National Science Council of the Republic of China, Taiwan (MOST 107-2218-E-167-001)
This publication has 39 references indexed in Scilit:
- Mom feels what her child feels: thermal signatures of vicarious autonomic response while watching children in a stressful situationFrontiers in Human Neuroscience, 2013
- Intranasal oxytocin enhances emotion recognition from dynamic facial expressions and leaves eye-gaze unaffectedPsychoneuroendocrinology, 2012
- Infrared thermal imaging in medicinePhysiological Measurement, 2012
- Thermal Imaging of the Periorbital Regions during the Presentation of an Auditory Startle StimulusPLOS ONE, 2011
- Infrared thermal imaging as a physiological access pathway: a study of the baseline characteristics of facial skin temperaturesPhysiological Measurement, 2009
- Partial volume correction of the microPET blood input function using ensemble learning independent component analysisPhysics in Medicine & Biology, 2009
- Characterization of the image-derived carotid artery input function using independent component analysis for the quantitation of [18F] fluorodeoxyglucose positron emission tomography imagesPhysics in Medicine & Biology, 2007
- Facial Skin Surface Temperature Changes During a “Concealed Information” TestAnnals of Biomedical Engineering, 2006
- Fast and robust fixed-point algorithms for independent component analysisIEEE Transactions on Neural Networks, 1999
- Emotion elicitation using filmsCognition and Emotion, 1995