H-Mem: Harnessing synaptic plasticity with Hebbian Memory Networks
Limbacher, T.; Legenstein, R.
Show abstract
The ability to base current computations on memories from the past is critical for many cognitive tasks such as story understanding. Hebbian-type synaptic plasticity is believed to underlie the retention of memories over medium and long time scales in the brain. However, it is unclear how such plasticity processes are integrated with computations in cortical networks. Here, we propose Hebbian Memory Networks (H-Mems), a simple neural network model that is built around a core hetero-associative network subject to Hebbian plasticity. We show that the network can be optimized to utilize the Hebbian plasticity processes for its computations. H-Mems can one-shot memorize associations between stimulus pairs and use these associations for decisions later on. Furthermore, they can solve demanding question-answering tasks on synthetic stories. Our study shows that neural network models are able to enrich their computations with memories through simple Hebbian plasticity processes.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- Leveraging prior concept learning improves ability to generalize from few examples in computational models of human object recognition 96%
- Unsupervised learning and clustered connectivity enhance reinforcement learning in spiking neural networks 95%
- Predictive coding with spiking neurons and feedforward gist signalling 94%
Similar papers in this journal
- Bridging Auditory Perception and Natural Language Processing with Semantically informed Deep Neural Networks 94%
- DeepAction: A MATLAB toolbox for automated classification of animal behavior in video 93%
- Generalising uncertainty improves accuracy and safety of deep learning analytics applied to oncology 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.