Back

OpenMonkeyChallenge: Dataset and Benchmark Challenges for Pose Tracking of Non-human Primates

Yao, Y.; Abhiraj Mohan, A.; Bliss-Moreau, E.; Coleman, K.; Freeman, S. M.; Machado, C. J.; Raper, J.; Zimmermann, J.; Hayden, B. Y.; Park, H. S.

2021-09-10 animal behavior and cognition
10.1101/2021.09.08.459549 bioRxiv
Show abstract

The ability to automatically track non-human primates as they move through the world is important for several subfields in biology and biomedicine. Inspired by the recent success of computer vision models enabled by benchmark challenges (e.g., object detection), we propose a new benchmark challenge called OpenMonkeyChallenge that facilitates collective community efforts through an annual competition to build generalizable non- human primate pose tracking models. To host the benchmark challenge, we provide a new public dataset consisting of 111,529 annotated (17 body landmarks) photographs of non-human primates in naturalistic contexts obtained from various sources including the internet, three National Primate Research Centers, and the Minnesota Zoo. Such annotated datasets will be used for the training and testing datasets to develop generalizable models with standardized evaluation metrics. We demonstrate the effectiveness of our dataset quantitatively by comparing it with existing datasets based on seven state-of-the-art pose tracking models.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.