Biologically Plausible Dopamine-Modulated STDP Model of Pavlovian Learning in Spiking Neural Networks
Park, W.; Lee, K. J.
Show abstract
Spike-timing-dependent plasticity (STDP) and dopamine (DA) are fundamental to reward-based learning and memory formation. A widely used DA-modulated STDP model explains how neural networks associate stimuli with delayed dopaminergic rewards through an eligibility trace. However, we show that this model supports learning even at unrealistically high DA concentrations because DA simply scales the magnitude of STDP without changing its temporal profile. In contrast, experiments demonstrate that DA nonlinearly reshapes the STDP window, converting long-term depression (LTD) into long-term potentiation (LTP) at high DA levels. We therefore propose a DA-modulated STDP rule in which increasing DA progressively biases plasticity toward potentiation while receptor saturation limits further DA effects beyond a critical concentration. Simulations of recurrent networks of Izhikevich neurons show that the proposed rule supports robust conditioning only within a biologically realistic DA range (0.04-0.70 {micro}M). Successful learning produces a hybrid network architecture consisting of a strong feedforward backbone embedded within recurrent circuitry and generates enhanced burst responses selectively to reward-associated stimuli. At the upper limit of the biologically plausible DA range, the network passes through a narrow bistable regime, converging to one of two distinct stable configurations. At higher DA concentrations, conditioning fails altogether. These results provide a biologically grounded model of DA-dependent plasticity and offer new insight into how abnormal dopamine signaling can impair learning in neurological disorders.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Tension shapes memory: Computational insights into neural plasticity 95%
- Unsupervised learning and clustered connectivity enhance reinforcement learning in spiking neural networks 95%
- Global remapping emerges as the mechanism for renewal of context-dependent behavior in a reinforcement learning model 95%
Similar papers in this journal
- Local, calcium- and reward-based synaptic learning rule that enhances dendritic nonlinearities can solve the nonlinear feature binding problem 97%
- Hippocampal sharp wave-ripples and the associated sequence replay emerge from structured synaptic interactions in a network model of area CA3 96%
- A computational model explains and predicts substantia nigra pars reticulata responses to pallidal and striatal inputs 96%
Similar papers in this journal
- Trial-to-trial variability of spiking delay activity in prefrontal cortex constrains burst-coding models of working memory 96%
- Differential excitability of PV and SST neurons results in distinct functional roles in inhibition stabilization of Up-states 96%
- Nonlinear dendritic integration supports Up-Down states in single neurons 96%
Similar papers in this journal
- On the Boundary Conditions of Avoidance Memory Reconsolidation: An Attractor Network Perspective 96%
- Spatial information transfer in hippocampal place cells depends on trial-to-trial variability, symmetry of place-field firing and biophysical heterogeneities 95%
- A Model for Navigation in Unknown Environments Based on a Reservoir of Hippocampal Sequences 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.