Synapses learn to utilize pre-synaptic noise for the prediction of postsynaptic dynamics
Kappel, D.; Tetzlaff, C.
Show abstract
Synapses in the brain are highly noisy, which leads to a large trial-by-trial variability. Given how costly synapses are in terms of energy consumption these high levels of noise are surprising. Here we propose that synapses use their noise to represent uncertainties about the activity of the post-synaptic neuron. To show this we utilize the free-energy principle (FEP), a well-established theoretical framework to describe the ability of organisms to self-organize and survive in uncertain environments. This principle provides insights on multiple scales, from high-level behavioral functions such as attention or foraging, to the dynamics of single microcircuits in the brain, suggesting that the FEP can be used to describe all levels of brain function. The synapse-centric account of the FEP that is pursued here, suggests that synapses form an internal model of the somatic membrane dynamics, being updated by a synaptic learning rule that resembles experimentally well-established LTP/LTD mechanisms. This approach entails that a synapse utilizes noisy processes like stochastic synaptic release to also encode its uncertainty about the state of the somatic potential. Although each synapse strives for predicting the somatic dynamics of its neuron, we show that the emergent dynamics of many synapses in a neuronal network resolve different learning problems such as pattern classification or closed-loop control in a dynamic environment. Hereby, synapses coordinate their noise processes to represent and utilize uncertainties on the network level in behaviorally ambiguous situations.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Homeostatic control of synaptic rewiring in recurrent networks induces the formation of stable memory engrams 98%
- Learning compositional sequences with multiple time scales through a hierarchical network of spiking neurons 98%
- Cooperative coding of continuous variables in networks with sparsity constraint 97%
Similar papers in this journal
Similar papers in this journal
- Confidence-controlled Hebbian learning efficiently extracts category membership from stimuli encoded in view of a categorization task 97%
- Training recurrent spiking neural networks in strong coupling regime 97%
- Mean-field approximations with adaptive coupling for networks with spike-timing-dependent plasticity 97%
Similar papers in this journal
- Are place cells just memory cells? Memory compression leads to spatial tuning and history dependence 97%
- A solution to temporal credit assignment using cell-type-specific modulatory signals 97%
- Orchestrated Excitatory and Inhibitory Learning Rules Lead to the Unsupervised Emergence of Self-sustained and Inhibition-stabilized Dynamics 97%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.