Back

Indirect decoding of behavior from brain signals via reconstruction of experimental conditions

Soch, J.; Haynes, J.-D.

2022-03-27 neuroscience
10.1101/2022.03.24.485588 bioRxiv
Show abstract

The data acquired during a functional magnetic resonance imaging (fMRI) experiment usually comprise experimental conditions, brain signals and behavioral responses. This reflects the underlying causal flow where the experimental conditions evoke brain responses that in turn result in behavior. In multivariate analyses, a common approach is to focus on the second step of that chain and to decode behavioral responses from brain signals. However, a different approach would be to first reconstruct the experimental conditions from brain signals and in turn use these to predict behavior. While this indirect approach would go against the causal chain of events, it might work better under certain circumstances, especially when the experimental conditions evoke much stronger measurable brain signals than the overt motor behavior. Here we tested this question directly by assessing the various mappings between conditions, brain signals and behavior in an open dataset. We found that the path of first decoding experimental conditions works surprisingly well, even though in our example data set, it is still outperformed by directly decoding the behavior from brain responses.

Matching journals

The top 2 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.