Multimodal EEG World Model: Self-Supervised Latent Transition Learning for Wearable EEG Seizure Detection
Yin, Z.; Zhu, H.
Show abstract
Existing supervised and self-supervised EEG models mainly learn discriminative or reconstructive representations within individual segments, while the transition information between adjacent EEG segments remains underexplored. In this study, we propose a Multimodal self-supervised EEG World Model for wearable seizure detection. Inspired by Le World Model, the proposed method encodes consecutive EEG segments into a shared latent space and predicts the next-segment latent representation from the current-segment representation conditioned on synchronized physiological information from ECG, EMG, and movement (MOV) signals. A learnable query-based fusion module aggregates the auxiliary multimodal representations into a compact physiological condition, while Sketched Isotropic Gaussian Regularization (SIGReg) is applied to stabilize the latent space and prevent representation collapse. After pretraining, only the pretrained EEG encoder is retained and frozen for linear binary probing, enabling EEG-only downstream seizure detection. We evaluated the proposed model on the SeizeIT2 wearable focal epilepsy dataset using a strict patient-wise training, validation, and test split. The proposed Multimodal EEG World Model achieved an AUPRC of 0.3748 , ROC-AUC of 0.8025 , and balanced accuracy of 0.7308 , ranking first on these three metrics among the ablation studies. It also achieved the highest AUPRC, ROC-AUC, balanced accuracy, and F1-score among the evaluated external baselines. These findings demonstrate that synchronized multimodal physiological information can provide useful contextual information for latent EEG transition learning and improve wearable EEG representation learning.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Time-adaptive Unsupervised Auditory Attention Decoding Using EEG-based Stimulus Reconstruction 94%
- Epileptic Spike Detection Using Neural Networks with Linear-Phase Convolutions 93%
- Hyperbolic graph embedding of MEG brain networks to study brain alterations in individuals with subjective cognitive decline 92%
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- Event Driven Neural Network on a Mixed Signal Neuromorphic Processor for EEG Based Epileptic Seizure Detection 95%
- Recurrent Neural Network-based Acute Concussion Classifier using Raw Resting State EEG Data 94%
- Feasibility of decoding covert speech in ECoG with aTransformer trained on overt speech 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.