A tale of three types of internal object representations in the human brain
Tian, S.; Mao, X.; Feng, R.; Wang, X.; Wang, D.-H.; Bi, Y.
Show abstract
How do internal brain representations bridge seeing an object and thinking about it after it disappears? Both object knowledge and mental imagery are involved in this process, engaging overlapping perceptual regions, yet whether their neural codes are shared or distinct remains unknown. We compared people with ("visualizers") and without voluntary visual imagery ("aphantasics") using fMRI, to examine experience of imagery sensation, and a multimodal deep neural network model, to examine representational contents (encoding text vs. image). We found distinct types of internal representations: (1) the left lateral occipitotemporal cortex (LOTC) encoded visual-structured knowledge linked to imagery sensation; (2) the bilateral fusiform gyrus, left dorsal LOTC, and right inferior frontal gyrus encoded language-structured knowledge independent of imagery sensation; and (3) the left superior parietal lobule maintained visual representation without prior knowledge, also independent of imagery. These findings reveal functionally and computationally distinct neural mechanisms that bridge seeing and thinking of objects, differing in their reliance on knowing and internal experiencing.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Evidence for abstract codes in parietal cortex guiding prospective working memory 96%
- The relative coding strength of object identity and nonidentity features in human occipito-temporal cortex and convolutional neural networks 96%
- The role of agentive and physical forces in the neural representation of motion events 96%
Similar papers in this journal
- Visual to default network pathways: A double dissociation between semantic and spatial cognition 96%
- Flexing the principal gradient of the cerebral cortex to suit changing semantic task demands 96%
- Schema representations in distinct brain networks support narrative memory during encoding and retrieval 96%
Similar papers in this journal
- Dual-stream cortical feedbacks mediate sensory prediction 97%
- Basis of executive functions in fine-grained architecture of cortical and subcortical human brain networks 96%
- A middle ground where executive control meets semantics: The neural substrates of semantic-control are topographically sandwiched between the multiple-demand and default-mode systems 95%
Similar papers in this journal
- Cortical representational geometry of diverse tasks reveals subject-specific and subject-invariant cognitive structures 95%
- Dynamic layer-specific processing in the prefrontal cortex during working memory 95%
- Distinct neural representational geometries of numerosity in early visual and association regions of dorsal and ventral streams 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.