Back

The human language processing system straightens natural speech

Xu, J.; Nguyen, T. D.; Tang, J.; Huth, A. G.; Goris, R. L. T.

2026-07-02 neuroscience
10.64898/2026.06.30.735613 bioRxiv
Show abstract

Large language models trained on next-word prediction have impressive linguistic capabilities. This suggests that the goal of temporal prediction is essential to language processing, but how this goal impacts the structure of speech representations in the human brain remains unknown. Here, we test the hypothesis that prediction is facilitated by the temporal straightening of representational trajectories along the speech processing hierarchy. We developed a methodology for measuring the curvature of these trajectories using fMRI. Our method exploits a previously unknown connection between the timescale of single-unit responses and the curvature of population trajectories. We examined brain responses of subjects listening to natural speech. Response trajectories were most curved in lower-level auditory areas and progressively straightened along the cortical hierarchy. We presented the same speech stimuli and perturbed versions thereof to wavLM---a speech representation model that is well aligned with human brain responses---and found that hierarchical straightening effects are strongest for stimuli whose statistical structure resembles natural speech. Together, our results establish a direct connection between the goal of temporal prediction, the geometry of neural speech representations, and the cortical hierarchy of representational timescales.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
eLife
5828 papers in training set
Top 4%
17.8%
2
Proceedings of the National Academy of Sciences
2444 papers in training set
Top 2%
12.2%
3
Nature Communications
5641 papers in training set
Top 22%
7.6%
4
PLOS Computational Biology
1863 papers in training set
Top 5%
7.0%
5
NeuroImage
903 papers in training set
Top 2%
6.5%
50% of probability mass above
6
The Journal of Neuroscience
1025 papers in training set
Top 3%
6.5%
7
Journal of Neurophysiology
302 papers in training set
Top 0.9%
4.7%
8
Cerebral Cortex
396 papers in training set
Top 1%
4.7%
9
PLOS Biology
486 papers in training set
Top 1%
3.9%
10
Nature Human Behaviour
95 papers in training set
Top 0.6%
3.1%
11
Scientific Reports
3612 papers in training set
Top 37%
3.0%
12
Journal of Cognitive Neuroscience
135 papers in training set
Top 1.0%
2.0%
13
Nature Neuroscience
252 papers in training set
Top 3%
1.8%
14
Neurobiology of Language
29 papers in training set
Top 0.2%
1.7%
15
Neuron
337 papers in training set
Top 4%
1.6%
16
PLOS ONE
5266 papers in training set
Top 50%
1.6%
17
eneuro
439 papers in training set
Top 5%
1.6%
18
Communications Biology
993 papers in training set
Top 16%
1.6%
19
Science Advances
1243 papers in training set
Top 26%
1.1%
20
Current Biology
665 papers in training set
Top 8%
1.1%
21
Cell Reports
1498 papers in training set
Top 24%
1.1%
22
European Journal of Neuroscience
189 papers in training set
Top 3%
0.9%
23
Philosophical Transactions of the Royal Society B: Biological Sciences
72 papers in training set
Top 2%
0.6%
24
Frontiers in Human Neuroscience
77 papers in training set
Top 3%
0.6%