Cognitive Heat
Open Access
- 11 September 2017
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 1 (3) , 1-20
Abstract
Current digital systems are largely blind to users’ cognitive states. Systems that adapt to users’ states show great potential for augmenting cognition and for creating novel user experiences. However, most approaches for sensing cognitive states, and cognitive load specifically, involve obtrusive technologies, such as physiological sensors attached to users’ bodies. This paper present an unobtrusive indicator of the users’ cognitive load based on thermal imaging that is applicable in real-world. We use a commercial thermal camera to monitor a person’s forehead and nose temperature changes to estimate their cognitive load. To assess the effect of different levels of cognitive load on facial temperature we conducted a user study with 12 participants. The study showed that different levels of the Stroop test and the complexity of reading texts affect facial temperature patterns, thereby giving a measure of cognitive load. To validate the feasibility for real-time assessments of cognitive load, we conducted a second study with 24 participants, we analyzed the temporal latency of temperature changes. Our system detected temperature changes with an average latency of 0.7 seconds after users were exposed to a stimulus, outperforming latency in related work that used other thermal imaging techniques. We provide empirical evidence showing how to unobtrusively detect changes in cognitive load in real-time. Our exploration of exposing users to different content types gives rise to thermal-based activity tracking, which facilitates new applications in the field of cognition-aware computing.Keywords
Funding Information
- German Research Foundation within the SimTech Cluster of Excellence (EXC 310/2)
- Amplify project which received funding from the European Research Council (ERC) under the European Union's Horizon 2020 research and innovation programme (683008)
- Victorian State Government and Microsoft through their contributions to the Microsoft Research Centre for Social Natural User Interfaces
This publication has 60 references indexed in Scilit:
- The Autonomic Signature of Guilt in Children: A Thermal Infrared Imaging StudyPLOS ONE, 2013
- Mom feels what her child feels: thermal signatures of vicarious autonomic response while watching children in a stressful situationFrontiers in Human Neuroscience, 2013
- Objective measures, sensors and computational techniques for stress recognition and classification: A surveyComputer Methods and Programs in Biomedicine, 2012
- Fast by Nature - How Stress Patterns Define Human Experience and Performance in Dexterous TasksScientific Reports, 2012
- The use of nasal skin temperature measurements in studying emotion in macaque monkeysPhysiology & Behavior, 2011
- Coping with Stress: The Effectiveness of Different Types of MusicApplied Psychophysiology and Biofeedback, 2007
- Detecting Stress During Real-World Driving Tasks Using Physiological SensorsIEEE Transactions on Intelligent Transportation Systems, 2005
- The Computer for the 21st CenturyScientific American, 1991
- The effect of face fanning during recovery from exercise hyperthermiaCanadian Journal of Physiology and Pharmacology, 1987
- Task-evoked pupillary responses, processing load, and the structure of processing resources.Psychological Bulletin, 1982