Basal forebrain-derived acetylcholine encodes valence-free reinforcement prediction error.
Sturgill, J. F.; Hegedüs, P.; Li, S.; Chevy, Q.; Siebels, A.; Jing, M.; Li, Y.; Hangya, B.; Kepecs, A.
Show abstract
Acetylcholine (Ach) is released by the cholinergic basal forebrain (CBF) throughout the cortical mantle and is implicated in behavioral functions ranging from arousal to attention to learning. Yet what signal ACh provides to cortex remains unresolved, hindering our understanding of its functional roles. Here we demonstrate that the CBF signals unsigned reinforcement prediction error, in contrast to dopamine (DA) neurons that encode reward prediction error. We show that both CBF neuronal activity and acetylcholine (ACh) release at cortical targets signal reinforcement delivery, acquire responses to predictive stimuli and show diminished responses to expected outcomes, hallmarks of a prediction error. To compare ACh with DA, we simultaneously monitored the activity of both neuromodulators during a serial reversal learning task. ACh tracked learning as swiftly as DA during acquisition but lagged slightly during extinction, suggesting that these neuromodulators play complementary roles in reinforcement as their patterns of innervation, cellular targets, and signaling mechanisms are themselves complementary. Through retrograde viral tracing we show that the cholinergic and dopaminergic systems engage overlapping upstream circuits, accounting for their coordination during learning. This predictive and valence-free signal explains how ACh can proactively and retroactively improve the processing of behaviorally important stimuli, be they good or bad.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Orbitofrontal Cortex Influences Dopamine Dynamics Associated with Alloparental Behavioral Acquisition in Female Mice 97%
- Selective engagement of prefrontal VIP neurons in reversal learning 97%
- Motor cortical output for skilled forelimb movement is selectively distributed across projection neuron classes 97%
Similar papers in this journal
Similar papers in this journal
- A hippocampus-accumbens code guides goal-directed appetitive behavior 98%
- Distinct spatially organized striatum-wide acetylcholine dynamics for the learning and extinction of Pavlovian associations 97%
- Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types 97%
Similar papers in this journal
- Acetylcholine modulates prefrontal outcome coding during threat learning under uncertainty 98%
- Cholinergic Interneurons Drive Motivation by Promoting Dopamine Release in the Nucleus Accumbens 97%
- Mixed representations of choice direction and outcome by GABA/glutamate cotransmitting neurons in the entopeduncular nucleus 97%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.