Utilizing Pretrained Vision Transformers and Large Language Models for Epileptic Seizure Prediction
Preprint
Abstract
Repeated unprovoked seizures is a major source of concern for patients suffering from epilepsy. Predicting seizures before they occur is of interest to both machine-learning scientists as well as clinicians, and is an active area of research. The variability of EEG sensors, type of seizures, and specialized knowledge required for annotating the data complicates the large-scale annotation process essential for supervised predictive models. To address these challenges, we propose the use of Vision Transformers (ViTs) and Large Language Models (LLMs) that were originally trained on publicly available image or text data. Our work leverages these pre-trained models by refining the input, embedding, and classification layers in a minimalistic fashion to predict seizures. Our results demonstrate that LLM's outperforms the ViT's in patient-independent seizure prediction achieving a sensitivity of 79.02% which is 8% higher compared to ViT's and about 12% higher compared to a custom-designed ResNet-based model. Our work demonstrates the successful feasibility of pre-trained models for seizure prediction with its potential for improving the quality of life of people with epilepsy. Our code and related materials are available open-source at: https://github.com/pcdslab/UtilLLM_EPSKeywords
This publication has 11 references indexed in Scilit:
- Hybrid LSTM–Transformer Model for the Prediction of Epileptic Seizure Using Scalp EEGIEEE Sensors Journal, 2024
- CLEP: Contrastive Learning for Epileptic Seizure Prediction Using a Spatio-Temporal-Spectral NetworkIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2023
- An Epileptic Seizure Prediction Method Based on CBAM-3D CNN-LSTM ModelIEEE Journal of Translational Engineering in Health and Medicine, 2023
- A Multi-Channel Feature Fusion CNN-Bi-LSTM Epilepsy EEG Classification and Prediction Model Based on Attention MechanismIEEE Access, 2023
- Power efficient refined seizure prediction algorithm based on an enhanced benchmarkingScientific Reports, 2021
- Seizure related injuries – Frequent injury patterns, hospitalization and therapeutic aspectsChinese Journal of Traumatology, 2021
- Geometric Deep Learning for Subject Independent Epileptic Seizure Prediction Using Scalp EEG SignalsIEEE Journal of Biomedical and Health Informatics, 2021
- Deep Learning for Patient-Independent Epileptic Seizure Prediction Using Scalp EEG SignalsIEEE Sensors Journal, 2021
- Efficient Epileptic Seizure Prediction Based on Deep LearningIEEE Transactions on Biomedical Circuits and Systems, 2019
- Deep learning for time series classification: a reviewData Mining and Knowledge Discovery, 2019