Neural replay is connected to latent cause inference and supports fast generalization
Renz, F. M.; Grossman, S.; Daw, N.; Dayan, P.; Doeller, C. F.; Schuck, N. W.
Show abstract
Dynamic environments require generalizing knowledge through two computational mechanisms: Inferring clusters of equivalent observations and propagating reward expectations within a cluster. While neural replay has been linked to both, past work has not studied these processes simultaneously, leaving their relative importance for replay unclear. We used fMRI and computational modeling to investigate latent cause inference and replay in 52 participants during a value-based task with shared rewards across bandits. Participants learned this structure and achieved one-shot generalization after reversals, consistent with a latent cause inference process. fMRI during predecision pauses revealed backwards replay of shared-reward bandits in the visual cortex and medial temporal lobe. Trial-wise fluctuations in visual replay strength and content were better explained by value updates than by structure learning. Conversely, abstract reward structure representations were localized specifically to the MTL. These results demonstrate that on-task replay serves reward propagation within learned latent structures to facilitate fast generalization.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Neural mechanisms of credit assignment for inferred relationships in a structured world 98%
- Neuro-computational account of arbitration between imitation and emulation during human observational learning 98%
- Human hippocampus and dorsomedial prefrontal cortex infer and update latent causes during social interaction 97%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.