Back

Disentangling reward processes underlying payoff maximization from individual differences in gain frequency bias and reinforcement learning

Balasubramani, P. P.; Diaz-Delgado, J.; Grennan, G.; Zafar-Khan, M.; Alim, F.; Ramanathan, D.; Mishra, J.

2021-06-13 neuroscience
10.1101/2021.06.11.447974 bioRxiv
Show abstract

Choice selection strategies and decision making are typically investigated using multiple-choice gambling paradigms that require participants to maximize reward payoff. However, research shows that performance in such paradigms suffers from individual biases towards the frequency of gains to choose smaller local gains over larger longer term gain, also referred to as melioration. Here, we developed a simple two-choice reward task, implemented in 186 healthy human adult subjects across the adult lifespan to understand the behavioral, computational, and neural bases of payoff maximization versus melioration. The observed reward choice behavior on this task was best explained by a reinforcement learning model of differential future reward prediction. Simultaneously recorded and source-localized electroencephalography (EEG) showed that diminished theta-band activations in the right rostral anterior cingulate cortex (rACC) correspond to greater reward payoff maximization, specifically during the presentation of cumulative reward information at the end of each task trial. Notably, these activations (greater rACC theta) predicted depressed mood symptoms, thereby showcasing a reward processing marker of potential clinical utility. Significance StatementThis study presents cognitive, computational and neural (EEG-based) analyses of a rapid reward-based decision-making task. The research has the following three highlights. 1) It teases apart two core aspects of reward processing, i.e. long term expected value maximization versus immediate gain frequency melioration based choice behavior. 2) It models reinforcement learning based behavioral differences between individuals showing that observed performance is best explained by differential extents of reward prediction. 3) It investigates neural correlates in 186 healthy human subjects across the adult lifespan, revealing specific theta band cortical source activations in right rostral anterior cingulate as correlates for maximization that further predict depressed mood across subjects.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
The Journal of Neuroscience
1025 papers in training set
Top 1.0%
13.0%
2
Cognitive, Affective, & Behavioral Neuroscience
25 papers in training set
Top 0.1%
13.0%
3
NeuroImage
903 papers in training set
Top 1%
12.8%
4
Frontiers in Neuroscience
256 papers in training set
Top 0.3%
6.3%
5
Biological Psychology
21 papers in training set
Top 0.1%
5.6%
50% of probability mass above
6
Scientific Reports
3612 papers in training set
Top 26%
4.1%
7
Frontiers in Human Neuroscience
77 papers in training set
Top 0.4%
3.5%
8
eLife
5828 papers in training set
Top 37%
2.8%
9
eneuro
439 papers in training set
Top 3%
2.8%
10
Psychophysiology
77 papers in training set
Top 0.4%
2.8%
11
European Journal of Neuroscience
189 papers in training set
Top 1%
2.7%
12
Computational Psychiatry
12 papers in training set
Top 0.1%
1.9%
13
Cortex
119 papers in training set
Top 1%
1.7%
14
Neuropsychologia
85 papers in training set
Top 0.9%
1.5%
15
Cerebral Cortex
396 papers in training set
Top 3%
1.5%
16
Biological Psychiatry: Cognitive Neuroscience and Neuroimaging
71 papers in training set
Top 1.0%
1.3%
17
Brain Sciences
55 papers in training set
Top 1%
1.0%
18
Journal of Cognitive Neuroscience
135 papers in training set
Top 2%
1.0%
19
Social Cognitive and Affective Neuroscience
39 papers in training set
Top 0.4%
0.8%
20
Frontiers in Behavioral Neuroscience
49 papers in training set
Top 0.9%
0.8%
21
Imaging Neuroscience
282 papers in training set
Top 4%
0.8%
22
Frontiers in Psychiatry
87 papers in training set
Top 2%
0.8%
23
Nature Human Behaviour
95 papers in training set
Top 2%
0.8%
24
Human Brain Mapping
329 papers in training set
Top 4%
0.8%
25
Psychological Medicine
88 papers in training set
Top 2%
0.8%
26
Psychopharmacology
69 papers in training set
Top 0.8%
0.8%
27
Proceedings of the National Academy of Sciences
2444 papers in training set
Top 44%
0.6%
28
Journal of Neurophysiology
302 papers in training set
Top 4%
0.6%
29
International Journal of Psychophysiology
15 papers in training set
Top 0.3%
0.6%
30
PLOS Computational Biology
1863 papers in training set
Top 21%
0.6%