Modelling The Brain's Response To Natural Scenes In The Bottleneck Space.
Ndubuaku, H.
Show abstract
AO_SCPLOWBSTRACTC_SCPLOWComputational models that mirror the brains behaviour can help us understand human intelligence and SOTA techniques for modelling the brains response to visual stimuli use deep neural networks. However, the best-performing vision models are compute-intensive and functional brain activities are represented by high-dimensional matrices which exacerbate this inefficiency. To this end, we propose a novel approach which showed significant performance improvements by 1) Projecting both the visual stimuli features and brain responses to low-dimensional vectors and using a non-linear neural network to learn the mapping in the latent space. 2) Simultaneously modelling all vertices in the visual cortices of both the left and right hemispheres using an objective we call "Racing Loss". 3) Incorporating tiny leaks of the ground truth during training of this network. 4) First pre-training this network on all subjects then fine-tuning on each. We show that our method additionally achieved 12% higher Noise-Normalized Mean Correlation Scores compared to fully fine-tuning large vision models to the high-dimensional brain responses.
Matching journals
The top 10 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- A Deep Graph Neural Network Architecture for Modelling Spatio-temporal Dynamics in resting-state functional MRI Data 96%
- STAMP: Simultaneous Training and Model Pruning for Low Data Regimes in Medical Image Segmentation 95%
- Multi-dynamic Modelling Reveals Strongly Time-varying Resting fMRI Correlations 94%
Similar papers in this journal
- Probabilistic Brain MR Image Transformation Using Generative Models 94%
- Recurrent Neural Network-based Acute Concussion Classifier using Raw Resting State EEG Data 93%
- A novel interpretable deep transfer learning combining diverse learnable parameters for improved T2D prediction based on single-cell gene regulatory networks 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.