Dual stochasticity of neurons and synapses provides a biologically plausible learning
Teramae, J.-n.
Show abstract
Neurons and synapses in the cerebral cortex behave stochastically. The advantages of such stochastic properties have been proposed in several works, but the relationship and synergy between the stochasticities of neurons and synapses remain largely unexplored. Here, we show that these stochastic features can be inseparably integrated into a simple framework that provides a practical and biologically plausible learning algorithm that consistently accounts for various experimental results, including the most efficient power-law coding of the cortex. The derived algorithm overcomes many of the limitations of conventional learning algorithms of neural networks. As an experimentally testable prediction, we derived the slow retrograde modulation of the excitability of neurons from this algorithm. Because of the simplicity and flexibility of this algorithm, we anticipate that it will be useful in the development of neuromorphic devices and scalable AI chips, and that it will help bridge the gap between neuroscience and machine learning.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Dimensional Reduction of Emergent Spatiotemporal Cortical Dynamics via a Maximum Entropy Moment Closure 98%
- Parallel Synapses with Transmission Nonlinearities Enhance Neuronal Classification Capacity 97%
- The covariance perceptron: A new paradigm for classification and processing of time series in recurrent neuronal networks 97%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.