Emergent brain-like representations in a goal-directed neural network model of visual search
Pourrahimi, M.; Bashivan, P.
Show abstract
Animals actively engage with their environment to gather information, continuously shaping both their sensory input and behavior. Understanding this closed loop between perception and action remains a central challenge in neuroscience. A key example is active vision, where observers decide where to look next, selectively sampling from their visual space to guide ongoing perception and action. However, despite major advances in linking neural activity with behavior and computational modeling of vision under passive viewing conditions, the interactive aspects of natural vision remain underexplored. Visual search, the act of locating a target among distractors, exemplifies this dynamic sampling process and has long served as a core paradigm for studying visual attention. While its behavioral and neural signatures have been characterized in humans and non-human primates, a unifying model that links these neural phenomena to behavior during visual search has been lacking. Here, we present a biologically aligned neural network model trained to perform visual search directly from natural scenes by generating sequences of saccades to locate a target. The model generalizes to novel objects and scenes, produces human-like scanpaths, and recapitulates classic behavioral biases in human visual search. Strikingly, units in the model exhibit neural response properties characteristic of the fronto-parietal network, including a stable cue template in working memory, a retinocentric cue-similarity map, and prospective fixation signals. Beyond reproducing known behavioral and neural phenomena, the model reveals a representational geometry that supports cue-driven prioritization, spatial memory, and planning of future fixations. These results establish a computational framework for studying visual search as an emergent property of goal-directed perception, offering concrete predictions for neurophysiological and behavioral testing, and paving the way toward a unified account of active vision.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Gain, not concomitant changes in spatial receptive field properties, improves task performance in a neural network attention model 97%
- Unsupervised changes in core object recognition behavior are predicted by unsupervised neural plasticity in inferior temporal cortex 97%
- A general decoding strategy explains the relationship between behavior and correlated variability 96%
Similar papers in this journal
- Tracking the mind's eye: Primate gaze behavior during virtual visuomotor navigation reflects belief dynamics 96%
- When the ventral visual stream is not enough: A deep learning account of medial temporal lobe involvement in perception 96%
- Decision formation in parietal cortex transcends a fixed frame of reference 96%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.