Back

Contribution of image statistics and semantics in local vs. distributed EEG decoding of rapid serial visual presentation

Holm, E. L.; Slezak, D. F.; Tagliazucchi, E.

2023-09-27 neuroscience
10.1101/2023.09.26.559617 bioRxiv
Show abstract

Spatio-temporal patterns of evoked brain activity contain information that can be used to decode and categorize the semantic content of visual stimuli. This procedure can be biased by statistical regularities which can be independent from the concepts that are represented in the stimuli, prompting the need to dissociate between the contributions of image statistics and semantics to decoding accuracy. We trained machine learning models to distinguish between concepts included in the THINGS-EEG dataset using electroencephalography (EEG) data acquired during a rapid serial visual presentation protocol. After systematic univariate feature selection in the temporal and spatial domains, we constructed simple models based on local signals which superseded the accuracy of more complex classifiers based on distributed patterns of information. Simpler models were characterized by their sensitivity to biases in the statistics of visual stimuli, with some of them preserving their accuracy after random replacement of the training dataset while maintaining the overall statistics of the images. We conclude that model complexity impacts on the sensitivity to confounding factors regardless of performance; therefore, the choice of EEG features for semantic decoding should ideally be informed by the underlying neurobiological mechanisms.

Matching journals

The top 8 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.