Cortical tracking of speech reveals top-down reconstructive processes
Mukherjee, S.; Tomassini, A.; Badino, L.; Pastore, A.; Fadiga, L.; D'Ausilio, A.
Show abstract
Cortical entrainment to the (quasi-) rhythmic components of speech seems to play an important role in speech comprehension. It has been suggested that neural entrainment may reflect top-down temporal predictions of sensory signals. Key properties of a predictive model are its anticipatory nature and its ability to reconstruct missing information. Here we put both these two properties to experimental test. We acoustically presented sentences and measured cortical entrainment to both acoustic speech envelope and lips kinematics acquired from the speaker but not visible to the participants. We then analyzed speech-brain and lips-brain coherence at multiple negative and positive lags. Besides the well-known cortical entrainment to the acoustic speech envelope, we found significant entrainment in the delta range to the (latent) lips kinematics. Most interestingly, the two entrainment phenomena were temporally dissociated. While entrainment to the acoustic speech peaked around +0.3 s lag (i.e., when EEG followed speech by 0.3 s), entrainment to the lips was significantly anticipated and peaked around 0-0.1 s lag (i.e., when EEG was virtually synchronous to the putative lips movement). Our results demonstrate that neural entrainment during speech listening involves the anticipatory reconstruction of missing information related to lips movement production, indicating its fundamentally predictive nature and thus supporting analysis by synthesis models.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Neural speech tracking benefit of lip movements predicts behavioral deterioration when the speaker's mouth is occluded 98%
- Eye Movements in Silent Visual Speech track Unheard Acoustic Signals and Relate to Hearing Experience 97%
- No evidence of musical training influencing the cortical contribution to the speech-FFR and its modulation through selective attention 97%
Similar papers in this journal
- The Neural Response at the Fundamental Frequency of Speech is Modulated by Word-level Acoustic and Linguistic Information 97%
- Cortical tracking of voice pitch in the presence of multiple speakers depends on selective attention 97%
- Amplified cortical tracking of word-level features of continuous competing speech in older adults 96%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.