Thermal Imaging as a Way to Classify Cognitive Workload
Authors:
- John StembergerJSJohn Stemberger
- Robert S. AllisonRobert S. Allison
- Thomas SchnellTSThomas Schnell
- 1 January 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 231-238
Abstract
As epitomized in DARPA's 'Augmented Cognition' program, next generation avionics suites are envisioned as sensing, inferring, responding to and ultimately enhancing the cognitive state and capabilities of the pilot. Inferring such complex behavioural states from imagery of the face is a challenging task and multimodal approaches have been favoured for robustness. We have developed and evaluated the feasibility of a system for estimation of cognitive workload levels based on analysis of facial skin temperature. The system is based on thermal infrared imaging of the face, head pose estimation, measurement of the temperature variation across regions of the face and an artificial neural network classifier. The technique was evaluated in a controlled laboratory experiment using subjective measures of workload across tasks as a standard. The system was capable of accurately classifying mental workload into high, medium and low workload levels 81% of the time. The suitability of facial thermography for integration into a multimodal augmented cognition sensor suite is discussed.Keywords
This publication has 7 references indexed in Scilit:
- Workload Assessment in Flight using Dense Array Eeg2006
- Facial Skin Surface Temperature Changes During a “Concealed Information” TestAnnals of Biomedical Engineering, 2006
- StressCam2005
- Real-Time Analysis of EEG Indexes of Alertness, Cognition, and Memory Acquired With a Wireless EEG HeadsetInternational Journal of Human–Computer Interaction, 2004
- Thermal image analysis for polygraph testingIEEE Engineering in Medicine and Biology Magazine, 2002
- Converting far infrared image information to other physiological dataIEEE Engineering in Medicine and Biology Magazine, 2000
- Cardiovascular differentiation of emotions.Psychosomatic Medicine, 1992