Thermal Facial Analysis for Deception Detection
Authors:
Open Access
- 14 April 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Forensics and Security
- Vol. 9 (6) , 1015-1023
Abstract
Thermal imaging technology can be used to detect stress levels in humans based on the radiated heat from their face. In this paper, we use thermal imaging to monitor the periorbital region's thermal variations and test whether it can offer a discriminative signature for detecting deception. We start by presenting an overview on automated deception detection and propose a novel methodology, which we validate experimentally on 492 thermal responses (249 lies and 243 truths) extracted from 25 participants. The novelty of this paper lies in scoring a larger number of questions per subject, emphasizing a within-person approach for learning from data, proposing a framework for validating the decision making process, and correct evaluation of the generalization performance. A $k$ -nearest neighbor classifier was used to classify the thermal responses using different strategies for data representation. We report an 87% ability to predict the lie/truth responses based on a within-person methodology and fivefold cross validation. Our results also show that the between-person approach for modeling deception does not generalize very well across the training data.
Keywords
Funding Information
- Engineering and Physical Sciences Research Council (EP/G004137/1)
This publication has 38 references indexed in Scilit:
- Border Security Credibility Assessments via Heterogeneous Sensor FusionIEEE Intelligent Systems, 2010
- Incremental Learning for Robust Visual TrackingInternational Journal of Computer Vision, 2007
- Facial Skin Surface Temperature Changes During a “Concealed Information” TestAnnals of Biomedical Engineering, 2006
- Imaging Facial Physiology for the Detection of DeceitInternational Journal of Computer Vision, 2006
- Monitoring of periorbital blood flow rate through thermal image analysis and its application to polygraph testing2005
- Appearing truthful generalizes across different deception situations.Journal of Personality and Social Psychology, 2004
- Thermal imaging for anxiety detection2002
- Thermal image analysis for polygraph testingIEEE Engineering in Medicine and Biology Magazine, 2002
- The Roles of Deception, Intention to Deceive, and Motivation to Avoid Detection in the Psychophysiological Detection of Guilty KnowledgePsychophysiology, 1991
- FACIAL FLUSHING AND SWEATING MEDIATED BY THE SYMPATHETIC NERVOUS SYSTEMBrain, 1987