Deep Fusion of VGG19 and ConvMixer With Superlet Transform for Cognitive Load Detection
- 6 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Consumer Electronics
- Vol. 71 (4) , 9557-9568
Abstract
The cognitive load triggers neural activity, which is crucial for understanding the brain’s response to mental stress or stimuli that induce stress. Electroencephalogram (EEG) signals were collected from a mental arithmetic task (MAT), simultaneous task EEG workload datasets and segmented into 4-second intervals. These segmented signals were then transformed into images using various time-frequency conversion methods (TF), including the Short-Time Fourier Transform (STFT), Continuous Wavelet Transform (CWT), Q Transform (QT), and Superlet Transform (SLT). The resulting TF images were fed into convolutional neural networks (CNNs), such as VGG19, ConvMixer, and a fusion of VGG19+ConvMixer. CNN models were trained using the Adam optimizer to detect cognitive load. The preprocessing involved normalization, and scaling in both phases. Among the models tested, the SLT-based TF-EEG with the fusion of the VGG19 and ConvMixer model outperformed other TF conversion methods and CNN architectures. The VGG19+ConvMixer utilizes the individual advantages of both VGG19 and ConvMixer models. It helps reduce overfitting and vanishing gradients, enhances performance with new data, improves GPU acceleration, and reduces computational cost due to its simpler architecture. However, the SLT effectively handles non-stationary data through its adaptive multi-resolution approach, making it ideal for EEG analysis. The SLT + VGG19 + ConvMixer model achieved accuracies of 97.26% on the MAT dataset and 96.04% on the STEW dataset, with all other evaluation metrics such as precision, sensitivity, specificity, F-score, MCC, Jaccard index, and Cohen’s kappa exceeding 94%. These findings can enhance real-time cognitive load monitoring, benefiting areas such as personalized learning, mental health, and stress management by detecting cognitive load to improve performance and reduce stress in critical situations.Keywords
This publication has 59 references indexed in Scilit:
- An End-to-End Brain Computer Interface System for Mental Workload Estimation through Hybrid Deep Learning ModelHuman-Centric Intelligent Systems, 2024
- Subject-Wise Cognitive Load Detection Using Time–Frequency EEG and Bi-LSTMArabian Journal for Science and Engineering, 2023
- Multifactor data analysis to forecast an individual's severity over novel COVID‐19 pandemic using extreme gradient boosting and random forest classifier algorithmsEngineering Reports, 2023
- CIS feature selection based dynamic ensemble selection model for human stress detection from EEG signalsCluster Computing, 2023
- Identifying mental fatigue of construction workers using EEG and deep learningAutomation in Construction, 2023
- Future forecasting prediction of Covid-19 using hybrid deep learning algorithmMultimedia Tools and Applications, 2022
- A novel technique for stress detection from EEG signal using hybrid deep learning modelNeural Computing and Applications, 2022
- Speech emotion recognition using deep 1D & 2D CNN LSTM networksBiomedical Signal Processing and Control, 2019
- Towards multilevel mental stress assessment using SVM with ECOC: an EEG approachMedical & Biological Engineering & Computing, 2017
- Deep learning with convolutional neural networks for EEG decoding and visualizationHuman Brain Mapping, 2017