Prediction tendency, eye movements, and attention in a unified framework of neural speech tracking
Schubert, J.; Gehmacher, Q.; Schmidt, F.; Hartmann, T.; Weisz, N.
Show abstract
Auditory speech comprehension is a multi-faceted process in which attention, prediction, and sensorimotor integration (via active sensing) interact with or complement each other. Although different conceptual models that focus on one of these aspects exist, we still lack a unified understanding of their role in speech processing. Here, we first replicated two recently published studies from our lab, confirming 1) a positive relationship between individual prediction tendencies and neural speech tracking, and 2) the phenomenon of ocular speech tracking - the tracking of attended speech by eye movements - and its shared contribution with neural activity to speech processing. In addition, we extended these findings with complementary analyses and investigated these phenomena in relation to each other in a multi-speaker paradigm with continuous, narrative speech. Importantly, prediction tendency and ocular speech tracking seem to be unrelated. In contrast to the shared contributions of oculomotor and neural activity to speech processing over a distributed set of brain regions that are critical for attention, individual prediction tendency and its relation to neural speech tracking seem to be largely independent of attention. Based on these findings, we propose a framework that aims to bridge the gaps between attention, prediction, and active (ocular) sensing in order to contribute to a holistic understanding of neural speech processing. In this speculative framework for listening, auditory inflow is, on a basic level, temporally modulated via active ocular sensing, and incoming information is interpreted based on probabilistic assumptions.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Attentional engagement with target and distractor streams predicts speech comprehension in multitalker environments 98%
- Linguistic structure and meaning organize neural oscillations into a content-specific hierarchy 98%
- Differential auditory and visual phase-locking are observed during audio-visual benefit and silent lip-reading for speech perception 97%
Similar papers in this journal
- Cross-modal interactions at the audiovisual cocktail-party revealed by behavior, ERPs, and neural oscillations 97%
- The integration of continuous audio and visual speech in a cocktail-party environment depends on attention 97%
- Language beyond the language system: dorsal visuospatial pathways support processing of demonstratives and spatial language during naturalistic fast fMRI 97%
Similar papers in this journal
- Carrier-frequency specific omission-related neural activity in ordered sound sequences are independent of omissions-predictability 97%
- Degradation levels of continuous speech affect neural speech tracking and alpha power differently 97%
- The Effect of Previously Encountered Sensory Information on Neural Representations of Predictability: Evidence from Human EEG 97%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.