Back

Dissecting the neuronal mechanisms of invariant word recognition

Agrawal, A.; Dehaene, S.

2023-11-07 neuroscience
10.1101/2023.11.06.565812 bioRxiv
Show abstract

Learning to read places a strong challenge on the visual system. Years of expertise lead to a remarkable capacity to separate highly similar letters and encode their relative positions, thus distinguishing words such as FORM and FROM invariantly over a large range of sizes and absolute positions. How neural circuits achieve invariant word recognition remains unknown. Here we address this issue through computational modeling and brain imaging. We first trained deep neural network models to recognize written words, then analyzed the reading-specialized units that emerged in deep layers. With literacy, units became sensitive to specific letter identities and their distance from the blank space at the left or right of a word, thus acting as "space bigrams" encoding ordinal position using an approximate number code. Using 7T functional MRI and magnetoencephalography in adults, we localized the predicted ordinal code anatomically (visual word form area) and temporally ([~]220ms). The proposed neuronal mechanism for invariant word recognition can explain reading errors and makes precise predictions about how position-invariant neural codes arise in brains and artificial systems.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.