Many-Two-One: Diverse Representations Across Visual Pathways Emerge from A Single Objective
Tang, Y.; Gokce, A.; Al-Karkari, K. J.; Yamins, D.; Schrimpf, M.
Show abstract
How the human brain supports diverse behaviours has been debated for decades. The canonical account posits distinct pathways in perceptual processing, such as the "what" and "where/how" visual streams, though their developmental origins and interdependency remain contested. Here, we show that families of deep neural network models develop features that accurately predict hours of human neural and behavioural recordings. By using these models as proxies for the brain and systematically probing developmental objectives, we identify two fundamental computations: object and appearance-free motion recognition, which drive the visual processing hierarchy and explain away alternative accounts. Strikingly, a single objective underlies both: they emerge from optimising for understanding world dynamics, with their organisation highly distributed and continuous across cortex rather than segregating into stream-like modes. Our results suggest that the human brains ability to integrate complex perceptual information across seemingly distinct pathways may originate from the single goal of modelling the world.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- Jaxley: Differentiable simulation enables large-scale training of detailed biophysical models of neural dynamics 96%
- Multi-Layered Maps of Neuropil with Segmentation-Guided Contrastive Learning 95%
- Lightning Pose: improved animal pose estimation via semi-supervised learning, Bayesian ensembling, and cloud-native open-source tools 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.