Predictive and Interpretable: Combining Artificial Neural Networks and Classic Cognitive Models to Understand Human Learning and Decision Making
Eckstein, M. K.; Summerfield, C.; Daw, N. D.; Miller, K. J.
Show abstract
Quantitative models of behavior are a fundamental tool in cognitive science. Typically, models are hand-crafted to implement specific cognitive mechanisms. Such "classic" models are interpretable by design, but may provide poor fit to experimental data. Artificial neural networks (ANNs), on the contrary, can fit arbitrary datasets at the cost of opaque mechanisms. Here, we adopt a hybrid approach, combining the predictive power of ANNs with the interpretability of classic models. We apply this approach to Reinforcement Learning (RL), beginning with classic RL models and replacing their components one-by-one with ANNs. We find that hybrid models can provide similar fit to fully-general ANNs, while retaining the interpretability of classic cognitive models: They reveal reward-based learning mechanisms in humans that are strikingly similar to classic RL. They also reveal mechanisms not contained in classic models, including separate rewardblind mechanisms, and the specific memory contents relevant to reward-based and reward-blind mechanisms.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Artificial neural networks for model identification and parameter estimation in computational cognitive models 98%
- Joint modeling of choices and reaction times based on Bayesian contextual behavioral control 96%
- A Recurrent Neural Network Model for Flexible and Adaptive Decision Making based on Sequence Learning 96%
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- When to retrieve and encode episodic memories: a neural network model of hippocampal-cortical interaction 97%
- On the normative advantages of dopamine and striatal opponency for learning and choice 97%
- Humans parsimoniously represent auditory sequences by pruning and completing the underlying network structure 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.