Choice-selective sequences in cortical inputs to the NAc provide a potential substrate for credit assignment
Parker, N. F.; Baidya, A.; Murugan, M.; Engelhard, B.; Zhukovskaya, A.; Goldman, M. S.; Witten, I. B.
Show abstract
How are actions linked with subsequent outcomes to guide choices? The nucleus accumbens, which is implicated in this process, receives glutamatergic inputs from the prelimbic cortex and midline regions of the thalamus. However, little is known about whether and how representations differ across these input pathways. By comparing these inputs during a reinforcement learning task in mice, we discovered that prelimbic cortical inputs preferentially represent actions and choices, whereas midline thalamic inputs preferentially represent cues. Choice-selective activity in the prelimbic cortical inputs is organized in sequences that persist beyond the outcome. Through computational modeling, we demonstrate that these sequences can support the neural implementation of reinforcement learning algorithms, both in a circuit model based on synaptic plasticity, and one based on neural dynamics. Finally, we test and confirm predictions of our circuit models by direct manipulation of nucleus accumbens input neurons. Thus, we integrate experiment and modeling to suggest neural solutions for credit assignment.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Mixed representations of choice direction and outcome by GABA/glutamate cotransmitting neurons in the entopeduncular nucleus 97%
- Control of adaptive action selection by secondary motor cortex during flexible visual categorization 97%
- Acetylcholine modulates prefrontal outcome coding during threat learning under uncertainty 97%
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.