Back

Energy Optimization Induces Predictive-coding Properties in a Multicompartment Spiking Neural Network Model

Zhang, M.; Bohte, S.

2024-01-20 neuroscience
10.1101/2024.01.17.575877 bioRxiv
Show abstract

AO_SCPLOWBSTRACTC_SCPLOWPredictive coding is a prominent theoretical framework for understanding the hierarchical sensory processing in the brain, yet how it could be implemented in networks of cortical neurons is still unclear. While most existing works have taken a hand-wiring approach to creating microcircuits that match experimental results, recent work in applying an optimisation approach to rate-based artificial neural networks revealed that cortical connectivity might result from self-organisation given some fundamental computational principle, such as energy efficiency. As no corresponding approach has studied this in more plausible networks of spiking neurons, we here investigate whether predictive coding properties in a multi-compartment spiking neural network can emerge from energy optimisation. We find that a model trained with an energy objective in addition to a task-relevant objective is able to reconstruct internal representations given top-down expectation signals alone. Additionally, neurons in the energy-optimised model also show differential responses to expected versus unexpected stimuli, qualitatively similar to experimental evidence for predictive coding. These findings indicate that predictive-coding-like behaviour might be an emergent property of energy optimisation, providing a new perspective on how predictive coding could be achieved in the cortex.

Matching journals

The top 2 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.