Back

Adaptive generalization and efficient learning under uncertainty

Park, J.; Chung, D.

2025-08-22 neuroscience
10.1101/2025.08.21.671603 bioRxiv
Show abstract

People often use recognizable features to infer the value of novel consumables. This "generalization" strategy is known to be beneficial in stable environments, such that individuals can use previously learned rules and values in efficiently exploring new situations. However, it remains unclear whether and how individuals adjust their generalization strategy in volatile environments where previously learned information becomes obsolete. We hypothesized that individuals adaptively use generalization by continuously updating their beliefs about the credibility of the feature-based reward generalization model at each state. Our data showed that participants used generalization more when the novel environment remained consistent with the previously learned monotonic association between feature and reward, suggesting efficient utilization of prior knowledge. Against other accounts, we found that individuals incorporated an arbitration mechanism between feature-based value generalization and model-based learning based on volatility tracking. Notably, our suggested model captured differential impacts of generalization dependent on the context-volatility, such that individuals who were biased the most toward generalization showed the lowest learning errors when the value of stimuli are generalized along the recognizable feature, but showed the highest errors in a volatile environment. This work provides novel insights into the adaptive usage of generalization, orchestrating two distinctive learning mechanisms through monitoring their credibility, and highlights the potential adverse effects of overgeneralization in volatile contexts.

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

1
PLOS Computational Biology
1633 papers in training set
Top 0.2%
33.2%
2
Psychological Review
19 papers in training set
Top 0.1%
8.5%
3
eLife
5422 papers in training set
Top 10%
7.2%
4
Scientific Reports
3102 papers in training set
Top 17%
6.4%
50% of probability mass above
5
Proceedings of the National Academy of Sciences
2130 papers in training set
Top 24%
2.8%
6
Nature Communications
4913 papers in training set
Top 43%
2.8%
7
Neural Networks
32 papers in training set
Top 0.2%
2.8%
8
PLOS ONE
4510 papers in training set
Top 50%
1.9%
9
eneuro
389 papers in training set
Top 5%
1.9%
10
Nature Human Behaviour
85 papers in training set
Top 2%
1.8%
11
Journal of Cognitive Neuroscience
119 papers in training set
Top 0.8%
1.7%
12
iScience
1063 papers in training set
Top 14%
1.7%
13
The Journal of Neuroscience
928 papers in training set
Top 6%
1.7%
14
Behavioral Neuroscience
25 papers in training set
Top 0.2%
1.5%
15
Philosophical Transactions of the Royal Society B
51 papers in training set
Top 3%
1.5%
16
Frontiers in Computational Neuroscience
53 papers in training set
Top 1%
1.3%
17
Cognition
44 papers in training set
Top 0.3%
1.3%
18
Journal of The Royal Society Interface
189 papers in training set
Top 3%
1.2%
19
Psychological Science
14 papers in training set
Top 0.1%
1.1%
20
PLOS Biology
408 papers in training set
Top 15%
1.1%
21
Frontiers in Behavioral Neuroscience
46 papers in training set
Top 0.7%
1.0%
22
NeuroImage
813 papers in training set
Top 5%
0.9%
23
Neural Computation
36 papers in training set
Top 0.6%
0.9%
24
Frontiers in Neuroscience
223 papers in training set
Top 7%
0.8%
25
Proceedings of the Royal Society B: Biological Sciences
341 papers in training set
Top 6%
0.8%
26
Cognitive, Affective, & Behavioral Neuroscience
25 papers in training set
Top 0.2%
0.8%
27
PNAS Nexus
147 papers in training set
Top 3%
0.6%
28
Computational Psychiatry
12 papers in training set
Top 0.2%
0.6%
29
Chaos, Solitons & Fractals
32 papers in training set
Top 2%
0.5%
30
Journal of Neurophysiology
263 papers in training set
Top 1%
0.5%