A neural circuit algorithm for action grammar
Liu, Y.; Tian, L. Y.; Tenenbaum, J. B.; Freiwald, W. A.; Wang, X.-J.
Show abstract
How does the brain generate sequences of discrete elements, such as actions or words, that follow an abstract rule (a grammar)? Motivated by an experiment in which monkeys learned to draw multi-object images according to grammatical rules, we trained a recurrent neural network to generate sequences Am Bn: producing shape A m times, then B n times, or vice versa. Our findings are threefold. First, the network plans the sequence by moving to an initial state encoding m and n along orthogonal directions for upcoming execution. Second, the network repeats each shape by progressing along a shape-specific manifold. Third, transitions from Am to Bn follow parallel trajectories between manifolds across values of n, thus preserving n. Each of these is an experimentally testable prediction. The network generalizes to longer novel sequences by starting further along the same orthogonal directions. These results reveal a neural circuit implementation of a symbolic algorithm for generating rule-based action sequences.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Neural trajectories in the supplementary motor area and primary motor cortex exhibit distinct geometries, compatible with different classes of computation 96%
- Linking Neural Manifolds to Principles of Circuit Structure 95%
- Direct-fit to nature: an evolutionary perspective on biological (and artificial) neural networks 95%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.