Direct Generation of Images from EEG using Schrödinger Bridge
Nobe, S.; Sasai, S.
Show abstract
Real-world data is often noisy, making it challenging to extract true signals Non-invasively recorded neural activities are among the most difficult data, yet its precise signal reconstruction is highly anticipated by communities developing non-invasive brain-machine interfaces. Several noise sources contribute to this challenge, including unrelated neuronal activity, non-brain bioelectricity, attenuation by the skull and scalp, and environmental noises. Additionally, the accumulation of noise varies significantly across subjects and recording sessions, resulting in widely diverging distributions of degraded observations. In this study, we propose modeling the noise accumulation process as a Schrodinger bridge and decoding the true signal by reversing this process. Compared to conventional guided Diffusion approach, our Schrodinger bridge approach effectively models diverse noise processes within a single framework, exhibiting greater robustness to inter-subject variability. Also, our approach doesnt require pre-aligning brain and image representations, which is an additional compute cost in the conventional approach.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Modeling and Inference Methods for Switching Regime-Dependent Dynamical Systems with Multiscale Neural Observations 95%
- Speech decoding from a small set of spatially segregated minimally invasive intracranial EEG electrodes with a compact and interpretable neural network 95%
- Linear versus deep learning methods for noisy speech separation for EEG-informed attention decoding 94%
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.