Co-existence of prediction and error signals in electrophysiological responses to natural speech
Broderick, M. P.; Lalor, E. C.
Show abstract
Prior knowledge facilitates perception and allows us to interpret our sensory environment. However, the neural mechanisms underlying this process remain unclear. Theories of predictive coding propose that feedback connections between cortical levels carry predictions about upcoming sensory events whereas feedforward connections carry the error between the prediction and the sensory input. Although predictive coding has gained much ground as a viable mechanism for perception, in the context spoken language comprehension it lacks empirical support using more naturalistic stimuli. In this study, we investigated theories of predictive coding using continuous, everyday speech. EEG recordings from human participants listening to an audiobook were analysed using a 2-stage regression framework. This tested the effect of top-down linguistic information, estimated using computational language models, on the bottom-up encoding of acoustic and phonetic speech features. Our results show enhanced encoding of both semantic predictions and surprising words, based on preceding context. This suggests that signals pertaining to prediction and error units can be observed in the same electrophysiological responses to natural speech. In addition, temporal analysis of these signals reveals support for theories of predictive coding that propose that perception is first biased towards what is expected followed by what is informative. Significance StatementOver the past two decades, predictive coding has grown in popularity as an explanatory mechanism for perception. However, there has been lack of empirical support for this theory in research studying natural speech comprehension. We address this issue by developing an analysis framework that tests the effects of top-down linguistic information on the auditory encoding of continuous speech. Our results provide evidence for the co-existence of prediction and error signals and support theories of predictive coding using more naturalistic stimuli.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Attentional engagement with target and distractor streams predicts speech comprehension in multitalker environments 99%
- Neural markers of speech comprehension: measuring EEG tracking of linguistic speech representations, controlling the speech acoustics 99%
- General auditory and speech-specific contributions to cortical envelope tracking revealed using auditory chimeras 98%
Similar papers in this journal
Similar papers in this journal
- More than Words: Neurophysiological Correlates of Semantic Dissimilarity Depend on Comprehension of the Speech Narrative 99%
- Neural tracking of the speech envelope predicts binaural unmasking 97%
- Carrier-frequency specific omission-related neural activity in ordered sound sequences are independent of omissions-predictability 96%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.