Sniffing Shapes Dopamine Signals for Reward Prediction
Scheller, M. F.; Luis, C.; Kelsch, W.
Show abstract
Adaptive behaviors depend on predicting outcomes from sensory evidence. Dopamine neurons in the ventral tegmental area (VTA) broadcast reward-prediction signals that guide learning. Yet the principles functionally coordinating information flow from input regions to VTA are incompletely understood. In the olfactory system, the sniff cycle structures sampling and odor encoding. We therefore asked whether this rhythm also entrains the ventral striatum to VTA communication and if so, how this shapes the implementation of predictive coding in dopamine neurons. We recorded identified dopamine neurons throughout olfactory conditioning and found that their firing shifted systematically to the post-inspiratory phase of the sniff cycle with learning. This temporal realignment predicted a neurons engagement in value encoding along the optimism-pessimism-spectrum of distributional reinforcement learning. This is associated with an enhanced phase-gated communication channel from the striatal olfactory tubercle to dopamine neurons, the strength of which predicts task performance. Thus, the sniffing rhythm provides a scaffold for information flow, revealing a phase-gating mechanism for the integration of outcome predicting sensory evidence to dopamine neurons during reinforcement learning. Significance StatementPredicting the future from sensory cues is central to adaptive behaviors. We show that sniffing temporally organizes the flow of information between the olfactory tubercle of ventral striatum and midbrain dopamine neurons during odor-guided learning in mice. Phase-specific coupling in the respiratory cycle determines when sensory information reaches dopamine neurons and how predictive signals are encoded. These findings link active-sensing rhythms to predictive reinforcement signals. This temporal scaffold yields a gradient of "optimistic" to "pessimistic" predictions consistent with distributional reinforcement-learning theories. These insights contribute to a better understanding of the large-scale computations across multiple brain regions to predict future outcomes.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Computational functions of precisely balanced neuronal assemblies in an olfactory memory network 97%
- Stimulus information guides the emergence of behavior related signals in primary somatosensory cortex during learning 97%
- NMDAR-dependent emergence of behavioral representation in primary visual cortex 97%
Similar papers in this journal
- A stable, distributed code for cue value in mouse cortex during reward learning 97%
- Dynamic organization of cerebellar climbing fiber response and synchrony in multiple functional modules reduces dimensions for reinforcement learning 97%
- Dynamics and maintenance of categorical responses in primary auditory cortex during task engagement 97%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.