Dissecting the neuronal mechanisms of invariant word recognition
Agrawal, A.; Dehaene, S.
Show abstract
Learning to read places a strong challenge on the visual system. Years of expertise lead to a remarkable capacity to separate highly similar letters and encode their relative positions, thus distinguishing words such as FORM and FROM invariantly over a large range of sizes and absolute positions. How neural circuits achieve invariant word recognition remains unknown. Here we address this issue through computational modeling and brain imaging. We first trained deep neural network models to recognize written words, then analyzed the reading-specialized units that emerged in deep layers. With literacy, units became sensitive to specific letter identities and their distance from the blank space at the left or right of a word, thus acting as "space bigrams" encoding ordinal position using an approximate number code. Using 7T functional MRI and magnetoencephalography in adults, we localized the predicted ordinal code anatomically (visual word form area) and temporally ([~]220ms). The proposed neuronal mechanism for invariant word recognition can explain reading errors and makes precise predictions about how position-invariant neural codes arise in brains and artificial systems.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Non-feature-specific elevated responses and feature-specific backward replay in human brain induced by visual sequence exposure 97%
- Successor-like representation guides the prediction of future events in human visual cortex and hippocampus 97%
- Differential destinations, dynamics, and functions of high- and low-order features in the feedback signal during object processing 97%
Similar papers in this journal
- The relative coding strength of object identity and nonidentity features in human occipito-temporal cortex and convolutional neural networks 97%
- Dimensionality and ramping: Signatures of sentence integration in the dynamics of brains and deep language models 97%
- Evidence for abstract codes in parietal cortex guiding prospective working memory 96%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.