Left frontal motor delta oscillations reflect the temporal integration of multimodal speech
Biau, E.; Schultz, B. G.; Gunter, T. C.; Kotz, S. A.
Show abstract
During multimodal speech perception, slow delta oscillations (~1 - 3 Hz) in the listeners brain synchronize with speech signal, likely reflecting signal decomposition at the service of comprehension. In particular, fluctuations imposed onto the speech amplitude envelope by a speakers prosody seem to temporally align with articulatory and body gestures, thus providing two complementary sensations to the speech signals temporal structure. Further, endogenous delta oscillations in the left motor cortex align with speech and music beat, suggesting a role in the temporal integration of (quasi)-rhythmic stimulations. We propose that delta activity facilitates the temporal alignment of a listeners oscillatory activity with the prosodic fluctuations in a speakers speech during multimodal speech perception. We recorded EEG responses in an audiovisual synchrony detection task while participants watched videos of a speaker. To test the temporal alignment of visual and auditory prosodic features, we filtered the speech signal to remove verbal content. Results confirm (i) that participants accurately detected audiovisual synchrony, and (ii) greater delta power in left frontal motor regions in response to audiovisual asynchrony. The latter effect correlated with behavioural performance, and (iii) decreased delta-beta coupling in the left frontal motor regions when listeners could not accurately integrate visual and auditory prosodies. Together, these findings suggest that endogenous delta oscillations align fluctuating prosodic information conveyed by distinct sensory modalities onto a common temporal organisation in multimodal speech perception.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- Attention drives visual processing and audiovisual integration during multimodal communication 98%
- Isolating neural signatures of conscious speech perception with a no-report sine-wave speechparadigm 97%
- Responses to Visual Speech in Human Posterior Superior Temporal Gyrus Examined with iEEG Deconvolution 97%
Similar papers in this journal
Similar papers in this journal
- Neural encoding of reliability of directional information during the preparation of targeted movements 96%
- Cortical tracking of voice pitch in the presence of multiple speakers depends on selective attention 96%
- Cortical-brainstem interplay during speech perception in older adults with and without hearing loss 96%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.