Back

Competitive performance and superior noise robustness of a non-negative deep convolutional spiking network

Rotermund, D.; Garcia-Ortiz, A.; Pawelzik, K. R.

2023-04-24 neuroscience
10.1101/2023.04.22.537923 bioRxiv
Show abstract

Networks of spiking neurons promise to combine energy efficiency with high performance. However, spiking models that match the performance of current state-of-the-art networks while requiring moderate computational resources are still lacking. Here we present an alternative framework to deep convolutional networks (CNNs), the "Spike by Spike" network (SbS), together with an efficient backpropagation algorithm. SbS implements networks based on non-negative matrix factorisation (NNMF), but uses discrete events as signals instead of real values. On clean data, the performance of CNNs is matched by both NNMF-based networks and SbS. SbS are found to be most robust when the data is corrupted by noise, specially when this noise was not seen before.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.