Continuous Assessment of Mental Workload During Complex Human–Machine Interaction: Inferring Cognitive State from Signals External to the Operator
Open Access
Abstract
The use of complex human–machine interfaces (HMIs) has grown rapidly over the last few decades in both industrial and personal contexts. Now more than ever, the study of mental workload (MWL) in HMI operators appears essential: when mental demand exceeds task load, cognitive overload arises, increasing the risk of work-related fatigue or accidents. In this paper, we propose a data-driven approach for the continuous estimation of the MWL of professional helicopter pilots in realistic simulated flights. Physiological and operational parameters were used to train a novel machine-learning model of MWL. Our algorithm achieves good performance (ROC AUC score 0.836 ± 0.081, the maximum F1 score 0.842 ± 0.078 and PR AUC score 0.820 ± 0.097) and shows that the operational information outperforms the physiological signals in terms of predictive power for MWL. Our results pave the way towards intelligent systems able to monitor the MWL of HMI operators in real time and question the relevancy of physiology-derived metrics for this task.Keywords
Funding Information
- Association Nationale de la Recherche et de la Technologie (2019/0295, 2022/0467)
- IdAML (Industrial Data Analytics & Machine Learning) (2019/0295, 2022/0467)
- PIA (2019/0295, 2022/0467)
This publication has 61 references indexed in Scilit:
- Evaluating mental workload during multitasking in simulated flightBrain and Behavior, 2022
- Perceptual-motor stylesExperimental Brain Research, 2021
- Instantaneous mental workload assessment using time–frequency analysis and semi-supervised learningCognitive Neurodynamics, 2020
- Measuring mental workload using physiological measures: A systematic reviewApplied Ergonomics, 2019
- Electrocardiographic features for the measurement of drivers' mental workloadApplied Ergonomics, 2017
- Sensory reweighting in controls and stroke patientsClinical Neurophysiology, 2013
- Hierarchical task analysis: Developments, applications, and extensionsApplied Ergonomics, 2006
- Recovery of standing balance in postacute stroke patients: a rehabilitation cohort study11No commercial party having a direct financial interest in the results of the research supporting this article has or will confer a benefit upon the authors(s) or upon any organization with which the author(s) is/are associated.Archives of Physical Medicine and Rehabilitation, 2004
- Bagging predictorsMachine Learning, 1996
- Assessing pilot workload. Why measure heart rate, HRV and respiration?Biological Psychology, 1992