Horizontally Tiled Network of Cortico-Basal Ganglia Modules Performs Reinforcement Learning
Hirokane, K.; Takehara, R.; Kita, T.; Onoi, S.; Matsushita, S.; Kitsukawa, T.
Show abstract
The neocortex and basal ganglia nuclei are connected along regions that share the same topography and are arranged side-by-side. Inspired by the anatomical characteristics of the cerebrum, we developed a network in which the modules of the neocortex-basal ganglia unit were arranged in a horizontally tiled manner. By applying this network to reinforcement learning tasks, we demonstrated that reinforcement learning can be achieved through horizontal signals passing between modules. Each module not only performs its calculation but also provides signals to adjacent modules. This lateral transmission takes advantage of the differences in the projection ranges of the three basal ganglia pathways, the direct, indirect, and hyperdirect pathways, which have been examined in physiologic studies. We found that these differences enabled temporal-difference-error computations. This study proposes a novel strategy for information processing based on neocortical-basal ganglia circuits, highlighting the computational significance of their anatomically and physiologically clarified features.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Embedding stochastic dynamics of the environment in spontaneous activity by prediction-based plasticity 96%
- Predictive learning rules generate a cortical-like replay of probabilistic sensory experiences 96%
- Sensory-memory interactions via modular structure explain errors in visual working memory 96%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.