Critical periods support representation learning in a model of cortical processing
Wu, Z.; Bellec, G.; Delrocq, A.; Gerstner, W.
Show abstract
Exposure of the brain to multiple stimuli drives the development of cortical representations, likely controlled by rules of synaptic plasticity. However, the type of developmental plasticity rules that lead to high-level representations of objects are unknown. Here we study a generalized Hebbian plasticity model that includes a predictive component. The learning rule uses only quantities that are locally available at the site of the synapse, is consistent with recent plasticity experiments in pyramidal neurons, and, as opposed to backpropagation learning, does not need a detailed feedback architecture. Our model shows that limiting plasticity in time to critical periods of development improves the quality and stability of sensory representation across different cortical areas described as layers of an artificial neural network. Our model achieves state-of-the-art performance for bio-plausible plasticity models on both an abstract hierarchical object database and a large image dataset designed for unsupervised learning.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Learning probability distributions of sensory inputswith Monte Carlo Predictive Coding 98%
- Temporal resolution of spike coding in feedforward networks with signal convergence and divergence 97%
- Constrained brain volume in an efficient coding model explains the fraction of excitatory and inhibitory neurons in sensory cortices 97%
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.