The cortex encodes speech timing as departure from expectation, not as physical measurement
Molinaro, N.; Perez-Navarro, J.
Show abstract
Every syllable and every phoneme in natural speech has a different duration. This variability is conventionally treated as jitter, noise the brain must overcome to recover an underlying regularity. Here we show that the cortex encodes it as information. We recorded magnetoencephalography from 25 native listeners of Spanish during twenty minutes of spontaneous narrative speech in Spanish, a syllable-timed language in which durational variability is low, making it a conservative test case. We modelled cortical activity with three timing regressors defined at successively finer grains: deviation from the expected syllabic beat, from the expected phoneme onset, and from the expected duration of the phoneme just completed. Fitted jointly, and against acoustic and linguistic-surprisal baselines, each regressor explained unique activity in bilateral superior temporal cortex, with distinct response latencies spanning 70 to 200 ms. The duration regressor explained cortical activity beyond raw phoneme duration, whereas raw duration explained no additional variance once it was included. In a separate sample, removing this durational variability was costly: comprehension in noise degraded under imposed isochrony relative to natural timing. Durational variability is therefore not noise the cortex discards but information it encodes: not how long speech events last, but how far their timing departs from expectation, across a hierarchy of timescales.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- Shared neural underpinnings of multisensory integration and trial-by-trial perceptual recalibration 96%
- Stimulus dependencies---rather than next-word prediction---can explain pre-onset brain encoding during natural listening 95%
- Hierarchical encoding of natural sounds mixtures in ferret auditory cortex 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.