Back

Adoption of MMPose, a general purpose pose estimation library, for animal tracking

Choi, J. D.; Kumar, V.

2026-04-01 neuroscience
10.64898/2026.03.29.715167 bioRxiv
Show abstract

1Markerless pose estimation has emerged as a powerful technique for animal behavior quantification, capable of high resolution tracking of body parts. Many neuroscience labs rely on tools like DeepLabCut and SLEAP, which provide accessible interfaces but restrict users to a narrow set of models and configurations. In this work, we adopt MMPose an open source, general-purpose computer vision library to build a workflow for training and evaluating multiple state-of-the-art models on animal video datasets. We benchmark these models in two scenarios: (1) a complex maze assay with occlusions and varied backgrounds, and (2) a simpler open field arena with a high-contrast background. Our results show that a bottomup model (DEKR) delivers the highest accuracy in the complex task, whereas lighter-weight models (e.g., SLEAP) offer superior speed highlighting a clear trade-off between accuracy and throughput. We also evaluate a recently published foundation model (TopViewMouse-5K) trained on a large top-view mouse dataset to test its generalization. It performs poorly on our tasks at zero-shot, and even when we combine its data with our training set, we observe no consistent benefit. These findings emphasize the importance of context-specific model selection and the need for more diverse training data to create generalizable pose models. By leveraging a general-purpose vision library, researchers can flexibly choose models that best suit their experimental needs. This work illustrates how adopting advanced computer vision frameworks can accelerate behavioral neuroscience and genetics research, paving the way for more scalable, reproducible, and sensitive analysis of animal behavior.

Matching journals

The top 8 journals account for 50% of the predicted probability mass.

1
Nature Communications
4913 papers in training set
Top 17%
10.3%
2
PLOS Computational Biology
1633 papers in training set
Top 4%
7.3%
3
Nature Methods
336 papers in training set
Top 1%
6.9%
4
eneuro
389 papers in training set
Top 0.9%
6.9%
5
PLOS ONE
4510 papers in training set
Top 27%
6.5%
6
Journal of Neuroscience Methods
106 papers in training set
Top 0.3%
4.4%
7
eLife
5422 papers in training set
Top 19%
4.4%
8
Scientific Reports
3102 papers in training set
Top 35%
3.7%
50% of probability mass above
9
Cell Reports
1338 papers in training set
Top 20%
2.1%
10
Proceedings of the National Academy of Sciences
2130 papers in training set
Top 27%
2.1%
11
Communications Biology
886 papers in training set
Top 8%
1.7%
12
Frontiers in Behavioral Neuroscience
46 papers in training set
Top 0.4%
1.7%
13
iScience
1063 papers in training set
Top 14%
1.7%
14
Frontiers in Neural Circuits
36 papers in training set
Top 0.2%
1.7%
15
Frontiers in Neuroscience
223 papers in training set
Top 4%
1.5%
16
Neuron
282 papers in training set
Top 6%
1.5%
17
NeuroImage
813 papers in training set
Top 4%
1.5%
18
Patterns
70 papers in training set
Top 1%
1.5%
19
Imaging Neuroscience
242 papers in training set
Top 2%
1.4%
20
BMC Biology
248 papers in training set
Top 2%
1.4%
21
Frontiers in Neuroinformatics
38 papers in training set
Top 0.5%
1.2%
22
PLOS Biology
408 papers in training set
Top 13%
1.2%
23
Nature Neuroscience
216 papers in training set
Top 5%
1.1%
24
Cell Reports Methods
141 papers in training set
Top 4%
1.0%
25
Scientific Data
174 papers in training set
Top 2%
1.0%
26
BMC Bioinformatics
383 papers in training set
Top 6%
0.9%
27
PLOS Genetics
756 papers in training set
Top 13%
0.9%
28
Nature
575 papers in training set
Top 14%
0.8%
29
Neural Networks
32 papers in training set
Top 0.7%
0.8%
30
Briefings in Bioinformatics
326 papers in training set
Top 6%
0.8%