To find better neural network models of human vision, find better neural network models of primate vision
Jozwik, K. M.; Schrimpf, M.; Kanwisher, N.; DiCarlo, J. J.
Show abstract
Specific deep artificial neural networks (ANNs) are the current best models of ventral visual processing and object recognition behavior in monkeys. We here explore whether models of non-human primate vision generalize to visual processing in the human primate brain. Specifically, we asked if model match to monkey IT is a predictor of model match to human IT, even when scoring those matches on different images. We found that the model match to monkey IT is a positive predictor of the model match to human IT (R = 0.36), and that this approach outperforms the current standard predictor of model accuracy on ImageNet. This suggests a more powerful approach for pre-selecting models as hypotheses of human brain processing.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- PsychRNN: An Accessible and Flexible Python Package for Training Recurrent Neural Network Models on Cognitive Tasks 92%
- Differential involvement of EEG oscillatory components in sameness vs. spatial-relation visual reasoning tasks 92%
- Neurophysiological evidence for cognitive map formation during sequence learning 92%
Similar papers in this journal
Similar papers in this journal
- Dynamic representation of multidimensional object properties in the human brain 95%
- The spatiotemporal neural dynamics of object recognition for natural images and line drawings 95%
- Deep neural networks and visuo-semantic models explain complementary components of human ventral-stream representational dynamics 94%
Similar papers in this journal
- Encoding neural representations of time-continuous stimulus-response transformations in the human brain with advanced deep neural networks 96%
- The Individualized Neural Tuning Model: Precise and generalizable cartography of functional architecture in individual brains 95%
- Representational similarity learning reveals a graded multi-dimensional semantic space in the human anterior temporal cortex 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.