High-level visual and motor regions are doubly dissociated in controlled tasks but only at specific times during natural behaviors

Our knowledge of the neural basis of sensory and motor information processing comes largely from recording brain activity in controlled settings. This approach, while insightful, blinds us from understanding natural behaviors, which involve far richer visual inputs and far larger range of movements. The prevailing belief is that, during natural behaviors, movement information would modulate visual cortex, and visual inputs would modulate motor cortex. Alternatively, this mixing might only reflect correlations between sensory inputs and movements present during natural behavior. To resolve this issue, we performed wireless recordings from high-level visual (IT) and motor regions (PMv/PFC) in freely moving monkeys while they performed a natural task and a fixation task. In each task, we extracted visual and movement features and asked to what degree these features explained neural activity. In the fixation task, we found a striking double dissociation whereby visual (but not movement) features predicted neural activity in IT, whereas motor (but not visual) features predicted neural activity in PMv & PFC. This dissociation was far weaker in the natural task but present particularly at key events when the visual and motor features were less correlated. Thus, high-level sensory and motor regions in the brain are doubly dissociated under controlled conditions, and remain so at specific times during natural behavior.