Back

Preferred visual experiences provide intuitive descriptions of the functional properties of the cortical navigation network

Zhang, T.; Cho, C. J.; Gallant, J. L.

2026-09-08 neuroscience
10.64898/2026.09.02.749001 bioRxiv
Show abstract

Complex, high-dimensional brain representations are often difficult to understand intuitively. Recent advances in generative neural networks have made it possible to predict the optimal stimulus that maximizes the activity in a specific brain region. Because these stimuli are in image space, they provide an intuitive understanding of the functional properties of that region. Previous work on optimized stimuli has focused on passive perceptual tasks. Yet real-world perception operates in a closed loop with cognition and action, and so passive stimuli are unlikely to be optimal for many brain regions. In a previous study, we used fMRI to record BOLD activity from participants actively navigating through a virtual world. We identified a network of 11 cortical regions that support active navigation and are tuned for complex feature combinations. Here, we used a variational autoencoder to generate video clips predicted to correspond to maximal activity in each region. These preferred visual experiences capture dynamic scenes that incorporate both world events and participant actions. These preferred visual experiences provide intuitive descriptions of the functional properties of each region, and suggest that these regions are more engaged during dynamic than static scenes. These patterns also generate novel, data-driven hypotheses for future study.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.