Online synaptic credit assignment in active dendrites
He, G.; Zhang, S.; Du, K.; Huang, T.
Show abstract
Credit assignment in neural networks is usually formulated as the computation of an abstract error gradient. Whether such a gradient can take a physical, causal form in biophysically detailed multi-compartment neuron models, and enable online, supervised learning, remains unclear. Here we show that the gradient of a detailed neuron's voltage with respect to a synaptic weight is itself a voltage. Differentiating the discrete backward-Euler update solved by standard simulators yields equations of the same form as the original voltage dynamics, driven by gradient currents. Replaying weight-specific gradient currents forward in time reproduces the exact gradient with high fidelity in an L5 pyramidal neuron across diverse input regimes (R2 > 0.998). Pairing the replayed gradient voltage with a local learning signal yields a causal, online learning rule. A single L5 pyramidal neuron with active dendrites learns to reproduce target voltage trajectories containing calcium plateaus and bursts, and recurrent networks of detailed neurons learn to generate target temporal patterns, far outperforming a readout-only control. These results demonstrate that synaptic credit assignment can be implemented online by the voltage dynamics of detailed neurons, potentially suggesting a physical substrate for gradient-based supervised learning in the brain.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- From space to time: Spatial inhomogeneities lead to the emergence of spatio-temporal activity sequences in spiking neuronal networks 96%
- "Backpropagation and the brain" realized in cortical error neuron microcircuits 96%
- Learning compositional sequences with multiple time scales through a hierarchical network of spiking neurons 96%
Similar papers in this journal
- Linking Neural Manifolds to Principles of Circuit Structure 96%
- Neural trajectories in the supplementary motor area and primary motor cortex exhibit distinct geometries, compatible with different classes of computation 95%
- A general principle of dendritic constancy – a neuron’s size and shape invariant excitability 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.