Self-supervised learning yields representational signatures of category-selective cortex
Janini, D.; Cichy, R.
Show abstract
The ventral visual stream contains category-selective regions with distinct feature tuning, most prominently the fusiform face area (FFA) and parahippocampal place area (PPA). Why do these brain regions exhibit distinct tuning properties? Here, we test the hypothesis that brain-like category-selective features naturally emerge from a general visual learning mechanism without domain-specific biases. Applying a functional localizer approach to both humans and self-supervised neural networks, we identified face- and scene-selective units in the brain and in models. We then measured fMRI and model responses to a broad stimulus set probing classic representational signatures of the FFA and PPA, including preferences relating to curvature, animacy, real-world size, mid-level features, face shapes, and spatial layout information. Category-selective model units largely recapitulate the distinct representational signatures of category-selective brain regions, capturing most of the effects in our test battery. Our findings demonstrate that domain-general learning objectives are sufficient to create humanlike category-selectivity, suggesting that the distinct representational signatures of category-selective cortex may emerge from a unified computational goal akin to self-supervised learning.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Driving and suppressing the human language network using large language models 95%
- White matter connections of human ventral temporal cortex are organized by cytoarchitecture, eccentricity, and category-selectivity from birth 95%
- Cortical recycling in high-level visual cortex during childhood development 95%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.