Decoding Individual Differences in Mental Information from Human Brain Response Predicted by Convolutional Neural Networks
Kawahata, K.; Wang, J.; Blanc, A.; Maeda, N.; Nishimoto, S.; Nishida, S.
Show abstract
Recent advantages in brain decoding with functional magnetic resonance imaging (fMRI) have enabled us to estimate individual differences in mental information from brain responses to natural stimuli. However, the physical constraints and costs of fMRI measurements prevent brain decoding from achieving real-world applications. We address this issue by building a novel framework to decode individual differences in mental information under natural situations from brain responses predicted using convolutional neural networks (CNNs). Once the CNN-based prediction model is trained using measured response, mental information can be decoded from the predicted responses of individual brains with no need for additional fMRI measurements. The model was found to capture individual-difference patterns consistent with conventional decoding using measured responses in 81/87 items to be decoded. Our framework has great potential to decode personal mental information with low dependence on fMRI measurements, which could help substantially expand the applicability of brain decoding in daily life.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Functional selectivity for naturalistic social interaction perception in the human superior temporal sulcus 97%
- Functional Annotation of Human Cognitive States using Deep Graph Convolution 96%
- Capturing Brain-Cognition Relationship: Integrating Task-Based fMRI Across Tasks Markedly Boosts Prediction and Test-Retest Reliability 96%
Similar papers in this journal
- Encoding neural representations of time-continuous stimulus-response transformations in the human brain with advanced deep neural networks 96%
- The Individualized Neural Tuning Model: Precise and generalizable cartography of functional architecture in individual brains 96%
- Alignment massive of auditory individual artificial networks with fMRI brain data leads to generalizable improvements in brain encoding and downstream tasks 95%
Similar papers in this journal
- Simultaneous Modeling of Reaction Times and Brain Dynamics in a Spatial Cuing Task 96%
- Non-linear manifold learning in fMRI uncovers a low-dimensional space of brain dynamics 95%
- DeepComBat: A Statistically Motivated, Hyperparameter-Robust, Deep Learning Approach to Harmonization of Neuroimaging Data 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.