Reconstruction of visual images from mouse retinal ganglion cell spiking activity using convolutional neural networks
Benster, T.; Babino, D.; Thickstun, J.; Hunt, M.; Liu, X.; Harchaoui, Z.; Oh, S.; Van Gelder, R. N.
Show abstract
All visual information in mammals is encoded in the aggregate pattern of retinal ganglion cell (RGC) firing. How this information is decoded to yield percepts remains incompletely understood. We have trained convolutional neural networks with multielectrode array-recorded murine RGC responses to projected images. The trained model accurately reconstructed novel facial images solely from RGC firing data. In this model, subpopulations of cells with faster firing rates are largely sufficient for accurate reconstruction, and ON- and OFF-cells contribute complementary and overlapping information to image reconstruction. Information content for reconstruction correlates with overall firing rate, and locality of information contributing to reconstruction varies substantially across the image and retina. This model demonstrates that artificial neural networks are capable of learning multicellular sensory neural encoding, and provides a viable model for understanding visual information encoding. Significance StatementConvolutional neural networks can be trained on high-density neuronal firing data from the optic nerve to reconstruct complicated images within a defined image space.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Fixational eye movements as active sensation for high visual acuity 96%
- Emergence of a contrast-invariant representation of naturalistic texture in macaque visual cortex 95%
- Systematic reduction of the dimensionality of natural scenes allows accurate predictions of retinal ganglion cell spike outputs. 95%
Similar papers in this journal
Similar papers in this journal
- Optogenetic stimulation recruits cortical neurons in amorphology-dependent manner 94%
- Nonlinear spatial integration underlies the diversity of retinal ganglion cell responses to natural stimuli 93%
- An emergent population code in primary auditory cortex supports selective attention to spectral and temporal sound features 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.