Subject-Specific Comparative Performance Analysis of Deep Learning Architectures for Motor Imagery Classification
Open Access
- 30 April 2026
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 14 (9) , 1527
Abstract
Motor Imagery (MI)-based brain–computer interfaces (BCIs) offer promising solutions for enhancing communication and motor functions in individuals with neurological impairments. However, decoding EEG signals accurately is difficult because of their poor signal-to-noise ratio and variability across subjects and sessions. In addition, EEG signals are sensitive to noise. Moreover, the low spatial resolution of EEG signals makes model generalization unreliable due to differences between signals across subjects. While several deep learning models have been developed, a fair comparison remains difficult due to differences in pre-processing, training procedures, and evaluation protocols. This study provides a systematic, controlled comparison of five deep learning approaches for subject-specific classification—EEGNet, EEG-TCNet, ShallowConvNet, DeepConvNet, and CTNet—using the BCI Competition IV datasets 2a and 2b. To enable an unbiased comparison, all models are trained using the same pipeline, with uniform pre-processing and training. Apart from classical accuracy scores, the effect of a constant set of hyper-parameters on the training dynamics, generalization capacity, and the susceptibility to overfitting is evaluated. The performance of the above-stated models is evaluated based on training dynamics, computational efficiency, accuracy, and the quality of the features learned by the models. Using the five-dimensional analysis framework consisting of quantitative performance metrics, training curves, confusion matrix analysis, ROC analysis, and t-SNE visualization techniques, the performance of the brain–computer interfaces is comprehensively analyzed. The experimental analysis confirms that CTNet outperforms other models, with accuracy values of 82.56% and 86.42% on the BCI competition IV datasets 2a and 2b, respectively. The EEGNet model is recognized as having the most potential in the field of real-time applications, owing to its light structure; meanwhile, the DeepConvNet model shows signs of overfitting, despite showing good accuracy. These findings highlight that model training characteristics and sensitivity to the hyper-parameters are important factors in evaluating deep learning models for MI-EEG classification problems.Keywords
This publication has 58 references indexed in Scilit:
- Classification of EEG Signal Using Deep Learning Architectures Based Motor-Imagery for an Upper-Limb Rehabilitation ExoskeletonSN Computer Science, 2025
- Application of transfer learning for biomedical signals: A comprehensive review of the last decade (2014–2024)Information Fusion, 2025
- TMSA-Net:A novel attention mechanism for improved motor imagery EEG signal processingBiomedical Signal Processing and Control, 2024
- Improving inter-session performance via relevant session-transfer for multi-session motor imagery classificationHeliyon, 2024
- Multi-branch spatial-temporal-spectral convolutional neural networks for multi-task motor imagery EEG classificationBiomedical Signal Processing and Control, 2024
- An in-depth survey on Deep Learning-based Motor Imagery Electroencephalogram (EEG) classificationArtificial Intelligence in Medicine, 2023
- Temporal–spatial transformer based motor imagery classification for BCI using independent component analysisBiomedical Signal Processing and Control, 2023
- A compact multi-branch 1D convolutional neural network for EEG-based motor imagery classificationBiomedical Signal Processing and Control, 2022
- Deep learning techniques for classification of electroencephalogram (EEG) motor imagery (MI) signals: a reviewNeural Computing and Applications, 2021
- Electroencephalography-based motor imagery classification using temporal convolutional network fusionBiomedical Signal Processing and Control, 2021