Mental Workload Classification and Tasks Detection in Multitasking: Deep Learning Insights from EEG Study
Open Access
- 31 January 2024
- journal article
- research article
- Published by MDPI AG in Brain Sciences
- Vol. 14 (2) , 149
Abstract
While the term task load (TL) refers to external task demands, the amount of work, or the number of tasks to be performed, mental workload (MWL) refers to the individual’s effort, mental capacity, or cognitive resources utilized while performing a task. MWL in multitasking scenarios is often closely linked with the quantity of tasks a person is handling within a given timeframe. In this study, we challenge this hypothesis from the perspective of electroencephalography (EEG) using a deep learning approach. We conducted an EEG experiment with 50 participants performing NASA Multi-Attribute Task Battery II (MATB-II) under 4 different task load levels. We designed a convolutional neural network (CNN) to help with two distinct classification tasks. In one setting, the CNN was used to classify EEG segments based on their task load level. In another setting, the same CNN architecture was trained again to detect the presence of individual MATB-II subtasks. Results show that, while the model successfully learns to detect whether a particular subtask is active in a given segment (i.e., to differentiate between different subtasks-related EEG patterns), it struggles to differentiate between the two highest levels of task load (i.e., to distinguish MWL-related EEG patterns). We speculate that the challenge comes from two factors: first, the experiment was designed in a way that these two highest levels differed only in the quantity of work within a given timeframe; and second, the participants’ effective adaptation to increased task demands, as evidenced by low error rates. Consequently, this indicates that under such conditions in multitasking, EEG may not reflect distinct enough patterns to differentiate higher levels of task load.Keywords
Funding Information
- European Commission (955901, 50231)
- European Commission (955901, 50231)
- Serbian Innovation Fund project StayAlert (955901, 50231)
This publication has 42 references indexed in Scilit:
- Effective Indices for Monitoring Mental Workload While Performing Multiple TasksPerceptual and Motor Skills, 2015
- Combining and comparing EEG, peripheral physiology and eye-related measures for the assessment of mental workloadFrontiers in Neuroscience, 2014
- Brain waves for automatic biometric-based user recognitionIEEE Transactions on Information Forensics and Security, 2014
- Assessment of mental fatigue during car driving by using high resolution EEG activity and neurophysiologic indices2012
- Estimating Brain Load from the EEGThe Scientific World Journal, 2009
- Neurophysiologic monitoring of mental workload and fatigue during operation of a flight simulator2005
- Phase synchronization for the recognition of mental tasks in a brain-computer interfaceIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2004
- Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural NetworksHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2003
- EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysisBrain Research Reviews, 1999
- Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research1988