Comparing serial and parallel language input: Shared neural representations with distinct encoding strengths
Krogh, S. M.; Pylkkänen, L.
Show abstract
Language can be experienced in highly serial form, as in speech, or in fully parallel form, as in text, yet how our brains adapt to differences in seriality is not understood. Here, we held modality constant (visual) and examined whether processing mechanisms underlying grammaticality detection are similar under Rapid Serial Visual Presentation (RSVP) and Rapid Parallel Visual Presentation (RPVP). To identify shared neural representations of grammaticality, we trained a classifier on magnetoencephalography (MEG) responses to grammatical and ungrammatical three-word phrases in one presentation mode and tested its generalization to the other. Behaviorally, accuracy was higher and reaction times faster for grammatical vs. ungrammatical phrases across presentation modes. Neurally, cross-presentation decoding revealed shared representations of grammaticality at word 2 across train-test directions--albeit with different latencies and durations--and an early shared representation at word 3 when trained on RPVP. We take the bidirectional representations at word 2 to capture distinct but presentation-invariant combinatorial processes and the asymmetry at word 3 as reflecting stronger global structure encoding in RPVP.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Diverging Neural Dynamics for Syntactic Structure Building in Naturalistic Speaking and Listening 95%
- Bilingual language processing relies on shared semantic representations that are modulated by each language 94%
- The neural architecture of language: Integrative modeling converges on predictive processing 94%
Similar papers in this journal
- Shared functional specialization in transformer-based language models and the human brain 95%
- Fast hierarchical processing of orthographic and semantic parafoveal information during natural reading 93%
- Convergent neural signatures of speech prediction error are a biological marker for spoken word recognition 93%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.