Video-Based Cattle Behavior Detection for Digital Twin Development in Precision Dairy Systems
Rao, S.; Garcia, E.; Neethirajan, S.
Show abstract
Digital twins in dairy systems require reliable behavioral inputs. We develop a video-based framework that detects and tracks individual cows and classifies seven behaviors under commercial barn conditions. From 4,964 annotated clips, expanded to 9,600 through targeted augmentation, we couple YOLOv11 detection with ByteTrack for identity persistence and evaluate SlowFast versus TimeSformer for behavior recognition. TimeSformer achieved 85.0% overall accuracy (macro-F1 0.84) and real-time throughput of 22.6 fps on RTX A100 hardware. Attention visualizations concentrated on anatomically relevant regions (head/muzzle for feeding and drinking; torso/limbs for postures), supporting biological interpretability. Structured outputs (cow ID, start-end times, durations, confidence) enable downstream use in nutritional modeling and 3D digital-twin visualization. The pipeline delivers continuous, per-animal activity streams suitable for individualized nutrition, predictive health, and automated management, providing a practical behavioral layer for scalable dairy digital twins.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- DAMM for the detection and tracking of multiple animals within complex social and environmental settings 94%
- An Assistive Computer Vision Tool to Automatically Detect Changes in Fish Behavior In Response to Ambient Odor 94%
- An Open-Source Tool for Automated Human-Level Circling Behavior Detection 93%
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.