CapuchinAI: Leveraging AI to study wild primate cognition
Sanchez Vargas, F.; Potluri, S. R.; Abernethy, J.; Benitez, M. E.
Show abstract
Advancing the study of primate cognition requires methods that preserve ecological validity while enabling the experimental control typical of laboratory research. We introduce CapuchinAI, a field-deployable touchscreen system that integrates real-time facial recognition with automated cognitive testing, providing a novel methodological framework for studying cognition in wild primates. Our approach combines a high-performing (>97% accuracy) YOLOv7-based facial recognition model (Multiple Capuchins v1.0) with a portable Raspberry Pi-driven touchscreen-reward apparatus designed for automated operation in natural habitats. The system detects approaching capuchins, initiates video recording, presents touchscreen stimuli, and dispenses food rewards contingent on task performance. During a two-week presentation to two habituated groups of wild white-faced capuchins (Cebus imitator) at the Taboga Forest Reserve, 16 individuals voluntarily interacted with the apparatus, 10 learned to trigger rewards, and 8 formed and retained robust screen-reward associations. The rapid habituation and learning rates demonstrate the feasibility of deploying AI-mediated cognitive experiments in the wild. CapuchinAI addresses several long-standing challenges in field cognition research by enabling: (1) autonomous, individualized task administration without researcher intervention; (2) standardized, repeatable trials across individuals and sessions; (3) scalable deployment across groups and sites; and (4) parallel data collection on behavior, identity, and performance. This methodology provides a blueprint for integrating machine learning, touchscreen testing, and automated reward delivery to study within- and between-individual cognitive variation under natural conditions. CapuchinAI represents a significant step toward long-term comparative research on primate cognition by making laboratory experimental paradigms accessible in the wild, bridging the gap between lab and field. Research HighlightsO_LIWe present CapuchinAI, a field-ready touchscreen testing station that uses real-time facial recognition to study cognition in wild capuchin monkeys C_LIO_LIWe developed a YOLOv7-based facial recognition model (Multiple Capuchins v1.0) that identifies individual capuchins with >97% precision and recall from static images, video, and live footage, enabling fully automated, individualized testing in the wild. C_LIO_LIWe integrated a version of this model into a closed-loop touchscreen-reward pipeline that detects an approaching monkey, presents a basic learning task, and automatically delivers food rewards based on the monkeys responses. C_LIO_LIWild capuchins rapidly habituated and learned touchscreen-reward associations, showing that AI-enabled touchscreens provide a scalable field method for deploying lab-style cognitive tests and mapping individual differences across tasks, species, and sites. C_LI
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Assessing Attentiveness and Cognitive Engagement across Tasks using Video-based Action Understanding in Non-Human Primates 94%
- USE: An integrative suite for temporally-precise psychophysical experiments in virtual environments for human, nonhuman, and artificially intelligent agents 94%
- REVS: A New Open-Source Platform for High-Resolution Analysis of Rodent Wheel Running Behavior 93%
Similar papers in this journal
- Enhancing student comprehension of paternity assignment in molecular primatology: a pilot study using a Shiny web application in Kenya 93%
- Personality assessment of synanthropic rhesus macaques: implications and challenges 93%
- Infrared thermography cannot be used to approximate core body temperature in wild primates 91%
Similar papers in this journal
- Digital embryos - A novel technical approach to investigate perceptual categorization in pigeons (Columba livia) using machine learning 93%
- An eye-tracking study of visual attention in chimpanzees and bonobos when viewing different tool-using techniques 92%
- Common marmosets (Callithrix jacchus) excel in a one-trial spatial memory test, yet perform poorly in a classical memory task 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.