Deception Detection and Remote Physiological Monitoring: A Dataset and Baseline Experimental Results
Authors:
- 4 August 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
We present the Deception Detection and Physiological Monitoring (DDPM) dataset and initial baseline results on this dataset. Our application context is an interview scenario in which the interviewee attempts to deceive the interviewer on selected responses. The interviewee is recorded in RGB, near-infrared, and long-wave infrared, along with cardiac pulse, blood oxygenation, and audio. After collection, data were annotated for interviewer/interviewee, curated, ground-truthed, and organized into train / test parts for a set of canonical deception detection experiments. Baseline experiments found random accuracy for micro-expressions as an indicator of deception, but that saccades can give a statistically significant response. We also estimated subject heart rates from face videos (remotely) with a mean absolute error as low as 3.16 bpm. The database contains almost 13 hours of recordings of 70 subjects, and over 8 million visible-light, near-infrared, and thermal video frames, along with appropriate meta, audio and pulse oximeter data. To our knowledge, this is the only collection offering recordings of five modalities in an interview scenario that can be used in both deception detection and remote photoplethysmography research.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Silesian Deception Database2015
- Deception Detection using Real-life Trial Data2015
- Photoplethysmography Revisited: From Contact to Noncontact, From Point to ImagingIEEE Transactions on Biomedical Engineering, 2015
- Saccadic eye movement rate as a cue to deceit.Journal of Applied Research in Memory and Cognition, 2015
- Thermal Facial Analysis for Deception DetectionIEEE Transactions on Information Forensics and Security, 2014
- Robust Pulse Rate From Chrominance-Based rPPGIEEE Transactions on Biomedical Engineering, 2013
- Non-contact, automated cardiac pulse measurements using video imaging and blind source separationOptics Express, 2010
- Motion Profiles for Deception Detection Using Visual Cues2010
- Lie Catching and Microexpressions2009
- THE IMPACT OF DECEPTION AND SUSPICION ON DIFFERENT HAND MOVEMENTSJournal of Nonverbal Behavior, 2006