Plasticity Dynamics Improves Reservoir Performance on Mixed-Timescale Memory Tasks
Becker, M. P.; Fauth, M.
Show abstract
Mixed-timescale signals are ubiquitous in natural stimuli and real-world applications, yet they remain challenging to process with recurrent neural networks. Reservoir computing offers an efficient framework for temporal processing, but extending its temporal range typically requires tuning neuronal timescales, which can compromise the representation of faster dynamics. Here, we propose an alternative approach in which synaptic plasticity provides an additional, slower timescale for computation. We introduce Hebbian plasticity into recurrent networks and show that its dynamics enable the reservoir to simultaneously process fast and slow components of mixed-timescale inputs: neuronal dynamics encode fast fluctuations, while synaptic dynamics support slower components. Remarkably, the resulting computational benefit extends over more than an order of magnitude beyond the intrinsic timescale of the plasticity. We show that this extended processing range arises from the dependence of the plasticity rule on postsynaptic activity, which effectively injects a filtered memory of past states into the network current. These results identify synaptic plasticity as a mechanism for extending the temporal processing capabilities of recurrent networks without altering neuronal timescales, and also suggest a potential computational role for plastic synapses in the processing of slowly varying stimuli in biological neuronal networks.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- From space to time: Spatial inhomogeneities lead to the emergence of spatio-temporal activity sequences in spiking neuronal networks 97%
- Switches to rhythmic brain activity lead to a plasticity-induced reset in synaptic weights 96%
- Temporal resolution of spike coding in feedforward networks with signal convergence and divergence 96%
Similar papers in this journal
- Linking Neural Manifolds to Principles of Circuit Structure 97%
- A unified theory for the computational and mechanistic origins of grid cells 95%
- Neural trajectories in the supplementary motor area and primary motor cortex exhibit distinct geometries, compatible with different classes of computation 95%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.