Natural constraints explain working memory capacity limitations in sensory-cognitive models
Xie, Y.; Duan, Y.; Cheng, A.; Jiang, P.; Cueva, C. J.; Yang, G. R.
Show abstract
The limited capacity of the brain to retain information in working memory has been well-known and studied for decades, yet the root of this limitation remains unclear. Here we built sensory-cognitive neural network models of working memory that perform tasks using raw visual stimuli. Contrary to intuitions that working memory capacity limitation stems from memory or cognitive constraints, we found that pre-training the sensory region of our models with natural images imposes sufficient constraints on models to exhibit a wide range of human-like behaviors in visual working memory tasks designed to probe capacity. Examining the neural mechanisms in our model reveals that capacity limitation mainly arises in a bottom-up manner. Our models offer a principled and functionally grounded explanation for the working memory capacity limitation without parameter fitting to behavioral data or much hyperparameter tuning. This work highlights the importance of developing models with realistic sensory processing even when investigating memory and other high-level cognitive phenomena.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Mechanisms of human dynamic object recognition revealed by sequential deep neural networks 98%
- Arousal state affects perceptual decision-making by modulating hierarchical sensory processing in a large-scale visual system model 97%
- Increasing neural network robustness improves match to macaque V1 eigenspectrum, spatial frequency preference and predictivity 97%
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.