Largely distinct networks mediate perceptually-relevant auditory and visual speech representations
Keitel, A.; Gross, J.; Kayser, C.
Show abstract
Visual speech is an integral part of communication, but it remains unclear whether information carried by lip movements is represented in the same brain regions that mediate acoustic speech comprehension. Our ability to understand acoustic speech seems independent from that to understand visual speech, yet neuroimaging studies suggest that the neural representations largely overlap. Addressing this discrepancy, we tested where the brain represents acoustically and visually conveyed word identities in a full-brain MEG study. Our analyses dissociate cerebral representations that merely reflect the physical stimulus from those that also predict comprehension, and suggest that these overlap only in specific temporal and frontal regions. Moreover, representations predictive of auditory and visual comprehension converge only in angular and inferior frontal regions. These results provide a neural explanation for the behavioural dissociation of acoustic and visual speech comprehension and suggest that cerebral representations encoding word identities may be more modality-specific than often upheld.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Predictive Neural Computations Support Spoken Word Recognition: Evidence from MEG and Competitor Priming 97%
- Differential auditory and visual phase-locking are observed during audio-visual benefit and silent lip-reading for speech perception 97%
- Linguistic structure and meaning organize neural oscillations into a content-specific hierarchy 97%
Similar papers in this journal
- Language beyond the language system: dorsal visuospatial pathways support processing of demonstratives and spatial language during naturalistic fast fMRI 98%
- A common neural code for meaning in discourse production and comprehension 97%
- Speech sound categorization: The contribution of non-auditory and auditory cortical regions 97%
Similar papers in this journal
- Neural signatures of second language proficiency in narrative processing. 97%
- The human language system, including its inferior frontal component in 'Broca's area', does not support music perception 97%
- Naturalistic audio-movies reveal common spatial organization across "visual" cortices of different blind individuals 97%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.