Measuring Mental Workload With Low-Cost and Wearable Sensors: Insights Into the Accuracy, Obtrusiveness, and Research Usability of Three Instruments
Authors:
Open Access
- 22 May 2017
- journal article
- research article
- Published by SAGE Publications in Journal of Cognitive Engineering and Decision Making
- Vol. 11 (4) , 323-336
Abstract
The affordability of wearable psychophysiological sensors has led to opportunities to measure the mental workload of operators in complex sociotechnical systems in ways that are more objective and less obtrusive. This study primarily focuses on the sensors themselves by investigating low-cost and wearable sensors in terms of their accuracy, obtrusiveness, and usability for research purposes. Two sensors were assessed on their accuracy as tools to measure mental workload through heart rate variability (HRV): the E3 from Empatica and the emWave Pro from HeartMath. The BioPatch from Zephyr Technology, which is an U.S. Food and Drug Administration–approved device, was used as a gold standard to compare the data obtained from the other 2 devices regarding their accuracy on HRV. Linear dependencies for 6 of 10 HRV parameters were found between the emWave and BioPatch data and for 1 of 10 for the E3 sensor. In terms of research usability, both the E3 and the BioPatch had difficulty acquiring either sufficiently high data recording confidence values or normal distributions. However, the BioPatch output files do not require postprocessing, which reduces costs and effort in the analysis stage. None of the sensors was perceived as obtrusive by the participants.Keywords
This publication has 27 references indexed in Scilit:
- A review of wearable sensors and systems with application in rehabilitationJournal of NeuroEngineering and Rehabilitation, 2012
- Dual-task motor performance with a tongue-operated assistive technology compared with hand operationsJournal of NeuroEngineering and Rehabilitation, 2012
- Sympathetic and parasympathetic activity in cancer-related fatigue: More evidence for a physiological substrate in cancer survivorsPsychoneuroendocrinology, 2011
- NeuroergonomicsCurrent Directions in Psychological Science, 2011
- Comparison of Time‐Domain Short‐Term Heart Interval Variability Analysis Using a Wrist‐Worn Heart Rate Monitor and the Conventional ElectrocardiogramPacing and Clinical Electrophysiology, 2008
- Fundamental examination of mental workload in the rail industryTheoretical Issues in Ergonomics Science, 2005
- Estimating Mental Effort Using Heart Rate and Heart Rate Variability2004
- Psychophysiological Methods2004
- Absolute Magnitude Estimation and Relative Judgement Approaches to Subjective Workload AssessmentProceedings of the Human Factors Society Annual Meeting, 1987
- A Validated Rating Scale for Global Mental Workload Measurement ApplicationsProceedings of the Human Factors Society Annual Meeting, 1983