Bimodal pilot study on inner speech decoding reveals the potential of combining EEG and fMRI
Simistira Liwicki, F.; Gupta, V.; Saini, R.; De, K.; Abid, N.; Rakesh, S.; Wellington, S.; Wilson, H.; Liwicki, M.; Eriksson, J.
Show abstract
The recognition of inner speech, which could give a voice to patients that have no ability to speak or move, is a challenge for brain-computer interfaces (BCIs). A shortcoming of the available datasets is that they do not combine modalities to increase the performance of inner speech recognition. Multimodal datasets of brain data enable the fusion of neuroimaging modalities with complimentary properties, such as the high spatial resolution of functional magnetic resonance imaging (fMRI) and the temporal resolution of electroencephalography (EEG), and therefore are promising for decoding inner speech. This paper presents the first publicly available bimodal dataset containing EEG and fMRI data acquired nonsimultaneously during inner-speech production. Data were obtained from four healthy, right-handed participants during an inner-speech task with words in either a social or numerical category. Each of the 8-word stimuli were assessed with 40 trials, resulting in 320 trials in each modality for each participant. The aim of this work is to provide a publicly available bimodal dataset on inner speech, contributing towards speech prostheses.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Low-Density EEG for Neural Activity Reconstruction Using Multivariate Empirical Mode Decomposition 96%
- Cross-Subject EEG-Based Emotion Recognition through Neural Networks with Stratified Normalization 96%
- Spatial (Mis)match Between EEG and fMRI Signal Patterns Revealed by Spatio-Spectral Source-Space EEG Decomposition 95%
Similar papers in this journal
- A Transfer Entropy-based methodology to analyze information flow under eyes-open and eyes-closed conditions with a clinical perspective 96%
- Subject, session and task effects on power, connectivity and network centrality: a source-based EEG study 96%
- Unveiling Stimulus Transduction Artifacts in Auditory Steady-State Response Experiments: Characterization, Risks, and Mitigation Strategies 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.