Back

Impaired Reinforcement Learning Underlying Explore-Exploit Decision Making in Theft Recidivists

Goto, Y.; Yoshino, S.; Kita, C.; Won, M.; Lee, Y.-A.

2026-09-16 neuroscience
10.64898/2026.09.11.750836 bioRxiv
Show abstract

Larceny imposes profound societal and economic burdens; however, punitive judicial measures frequently fail to deter recidivism. The neurobehavioral mechanisms driving habitual offending, whether instrumental or kleptomanic, in theft recidivists remain poorly understood. In this study, we investigated explore-exploit decision-making and underlying reinforcement learning architectures in theft recidivists with a 4-arm bandit task while prefrontal cortex (PFC) hemodynamics were continuously monitored using functional near-infrared spectroscopy (fNIRS). Model-free behavioral analyses revealed that non-kleptomanic (TR-K) but not kleptomanic (TR+K) theft recidivists accumulated significantly higher cumulative regret and made fewer optimal choices compared to control individuals without criminal records (CT). Model-based analyses through Variational Bayesian Analysis identified Q-learning with decay model as the optimal computational fit. Parameter extraction using the model demonstrated that the TR-K group exhibited a lower learning rate than CT and TR+K groups, indicating a learning deficit in updating action values following environmental feedback. fNIRS tracking of trial-by-trial latent reinforcement variables revealed that while PFC activity was modulated by these variables, group differences were characterized by static baseline hemodynamic shifts rather than rewirings of value-tracking neural circuits. These findings suggest that non-kleptomanic recurrent thefts may be associated with impaired reinforcement learning mechanisms, challenging current punitive deterrence models.

Matching journals

The top 12 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.