Back

Striatal dopamine pulses follow a temporal discounting spectrum

Wei, W.; Mohebi, A.; Berke, J.

2021-11-03 neuroscience
10.1101/2021.10.31.466705 bioRxiv
Show abstract

Dopamine input to striatum can encode reward prediction error, a critical signal for updating predictions of future rewards. However, it is unclear how this mechanism handles the need to make predictions, and provide feedback, over multiple time horizons: from seconds or less (if singing a song) to potentially hours or more (if hunting for food). Here we report that dopamine pulses in distinct striatal subregions convey reward prediction errors over distinct temporal scales. Dopamine dynamics systematically accelerated from ventral to dorsal-medial to dorsal-lateral striatum, in the tempo of their spontaneous fluctuations, their integration of prior rewards, and their discounting of future rewards. This spectrum of time scales for value computations can help achieve efficient learning and adaptive motivation for a wide range of behaviors.

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.