Energy Optimization Induces Predictive-coding Properties in a Multicompartment Spiking Neural Network Model
Zhang, M.; Bohte, S.
Show abstract
AO_SCPLOWBSTRACTC_SCPLOWPredictive coding is a prominent theoretical framework for understanding the hierarchical sensory processing in the brain, yet how it could be implemented in networks of cortical neurons is still unclear. While most existing works have taken a hand-wiring approach to creating microcircuits that match experimental results, recent work in applying an optimisation approach to rate-based artificial neural networks revealed that cortical connectivity might result from self-organisation given some fundamental computational principle, such as energy efficiency. As no corresponding approach has studied this in more plausible networks of spiking neurons, we here investigate whether predictive coding properties in a multi-compartment spiking neural network can emerge from energy optimisation. We find that a model trained with an energy objective in addition to a task-relevant objective is able to reconstruct internal representations given top-down expectation signals alone. Additionally, neurons in the energy-optimised model also show differential responses to expected versus unexpected stimuli, qualitatively similar to experimental evidence for predictive coding. These findings indicate that predictive-coding-like behaviour might be an emergent property of energy optimisation, providing a new perspective on how predictive coding could be achieved in the cortex.
Matching journals
The top 2 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Temporal resolution of spike coding in feedforward networks with signal convergence and divergence 98%
- Learning probability distributions of sensory inputswith Monte Carlo Predictive Coding 98%
- FORCE trained spiking networks do not benefit from faster learning while parameter matched rate networks do 98%
Similar papers in this journal
- Replay as a basis for backpropagation through time in the brain 98%
- The remarkable robustness of surrogate gradient learning for instilling complex function in spiking neural networks 97%
- Confidence-controlled Hebbian learning efficiently extracts category membership from stimuli encoded in view of a categorization task 96%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.