A new take on model-based and model-free influences on mental effort and striatal prediction errors
Feher da Silva, C.; Lombardi, G.; Edelson, M.; Hare, T. A.
Show abstract
A standard assumption in neuroscience is that low-effort model-free learning is automatic and continuously employed, while more complex model-based strategies are only used when the rewards they generate are worth the additional effort. We present evidence refuting this assumption. First, we demonstrate flaws in previous reports of combined model-free and model-based reward prediction errors in the ventral striatum that likely led to spurious results. More appropriate analyses yield no evidence of a model-free prediction errors in this region. Second, we find that task instructions generating more correct model-based behaviour reduce rather than increase mental effort. This is inconsistent with cost-benefit arbitration between model-based and model-free strategies. Together, our data suggest that model-free learning may not be automatic. Instead, humans can reduce mental effort by using a model-based strategy alone rather than arbitrating between multiple strategies. Our results call for re-evaluation of the assumptions in influential theories of learning and decision-making.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Neural signatures of arbitration between Pavlovian and instrumental action selection 97%
- Hippocampal and medial prefrontal cortices encode structural task representations following progressive and interleaved training schedules 96%
- Analogous computations in working memory input, output and motor gating: Electrophysiological and computational modeling evidence 96%
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.