A Deep Learning Framework for Predicting Functional Visual Performance in Bionic Eye Users
Skaza, J.; Murlidaran, S.; Varshney, A.; Wen, Z.; Wang, W.; Eckstein, M. P.; Beyeler, M.
Show abstract
Efforts to restore vision via neural implants have outpaced the ability to predict what users will perceive, leaving patients and clinicians without reliable tools for surgical planning or device selection. To bridge this critical gap, we introduce a computational virtual patient (CVP) pipeline that integrates anatomically grounded phosphene simulation with task-optimized deep neural networks (DNNs) to forecast patient perceptual capabilities across diverse prosthetic designs and tasks. We evaluate performance across six visual tasks, six electrode configurations, and two artificial vision models, positioning our CVP approach as a scalable pre-implantation method. Several chosen tasks align with the Functional Low-Vision Observer Rated Assessment (FLORA), revealing correspondence between model-predicted difficulty and real-world patient outcomes. Further, DNNs exhibited strong correspondence with psychophysical data collected from normally sighted subjects viewing phosphene simulations, capturing both overall task difficulty and performance variation across implant configurations. While performance was generally aligned, DNNs sometimes diverged from humans in which specific stimuli were misclassified, reflecting differences in underlying decision strategies between artificial agents and human observers. The findings position CVP as a scientific tool for probing perception under prosthetic vision, an engine to inform device development, and a clinically relevant framework for pre-surgical forecasting.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Increasing neural network robustness improves match to macaque V1 eigenspectrum, spatial frequency preference and predictivity 93%
- Mechanisms of human dynamic object recognition revealed by sequential deep neural networks 93%
- Pre-training artificial neural networks with spontaneous retinal activity improves motion prediction in natural scenes 93%
Similar papers in this journal
- Probing and predicting ganglion cell responses to smooth electrical stimulation in healthy and blind mouse retina 93%
- Brain-Guided Convolutional Neural Networks Reveal Task-Specific Representations in Scene Processing 93%
- Discrimination of finger movements by magnetomyography with optically pumped magnetometers 92%
Similar papers in this journal
- The causal role of the inferior temporal cortex in visual perception 93%
- Real-Time Brain-Machine Interface Achieves High-Velocity Prosthetic Finger Movements using a Biologically-Inspired Neural Network Decoder 93%
- Decoupling simultaneous motor imagination and execution via orthogonal ECoG neural representations 92%
Similar papers in this journal
- Biologically plausible phosphene simulation forthe differentiable optimization of visual corticalprostheses 93%
- Precise control of neural activity using dynamically optimized electrical stimulation 93%
- A conserved code for anatomy: Neurons throughout the brain embed robust signatures of their anatomical location into spike trains. 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.