Utilizing Pretrained Vision Transformers and LargeLanguage Models for Epileptic Seizure Prediction
Parani, P.; Mohammad, U.; Saeed, F.
Show abstract
Repeated unprovoked seizures is a major source of concern for patients suffering from epilepsy. Predicting seizures before they occur is of interest to both machine-learning scientists as well as clinicians, and is an active area of research. The variability of EEG sensors, type of seizures, and specialized knowledge required for annotating the data complicates the large-scale annotation process essential for supervised predictive models. To address these challenges, we propose the use of Vision Transformers (ViTs) and Large Language Models (LLMs) that were originally trained on publicly available image or text data. Our work leverages these pre-trained models by refining the input, embedding, and classification layers in a minimalistic fashion to predict seizures. Our results demonstrate that LLMs outperforms the ViTs in patient-independent seizure prediction achieving a sensitivity of 79.02% which is 8% higher compared to ViTs and about 12% higher compared to a custom-designed ResNet-based model. Our work demonstrates the successful feasibility of pre-trained models for seizure prediction with its potential for improving the quality of life of people with epilepsy. Our code and related materials are available open-source at: https://github.com/pcdslab/UtilLLM_EPS/
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Epileptic Spike Detection Using Neural Networks with Linear-Phase Convolutions 96%
- Time-adaptive Unsupervised Auditory Attention Decoding Using EEG-based Stimulus Reconstruction 95%
- Hyperbolic graph embedding of MEG brain networks to study brain alterations in individuals with subjective cognitive decline 93%
Similar papers in this journal
- Not one size fits all: influence of EEG type when training a deep neural network for interictal epileptiform discharge detection 96%
- Generalizable electroencephalographic classification of Parkinson’s Disease using deep learning 94%
- DermoExpert: Skin lesion classification using a hybrid convolutional neural network through segmentation, transfer learning, and augmentation 90%
Similar papers in this journal
- Event Driven Neural Network on a Mixed Signal Neuromorphic Processor for EEG Based Epileptic Seizure Detection 96%
- NLP-based tools for localization of the Epileptogenic Zone in patients with drug-resistant focal epilepsy 95%
- Recurrent Neural Network-based Acute Concussion Classifier using Raw Resting State EEG Data 95%
Similar papers in this journal
- PyHFO: Lightweight Deep Learning-poweredEnd-to-End High-Frequency Oscillations AnalysisApplication 97%
- Speech decoding from a small set of spatially segregated minimally invasive intracranial EEG electrodes with a compact and interpretable neural network 96%
- Satelight: Self-Attention-Based Model for Epileptic Spike Detection from Multi-Electrode EEG 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.