Validating Foundation Models for Automated Cattle Detection
Open Access
Abstract
Automated monitoring of cattle behavior through computer vision requires robust detection as a foundational step for tracking, re-identification, and behavior analysis. However, training accurate detection models typically demands extensive manually annotated datasets, creating a significant bottleneck for scaling cattle monitoring systems. In this work, we investigate whether automated annotation using foundation models can reliably replace manual labeling for cattle detection tasks. We introduce EMA (Extensive Mitrovac Annotations), a dataset of barn images with manually annotated cows with oriented bounding boxes including head orientation, posture labels (standing/lying), and visibility status (whole/partially visible). We systematically compare manualy annotated oriented bounding boxes with those generated by the Segment Anything Model 3 (SAM 3), demonstrating high agreement between automated and ground truth annotations. Furthermore, we train YOLO11-OBB detectors on both manual and SAM-generated annotations, showing that models trained on automated annotations achieve comparable performance to those trained on manual labels when evaluated on our ground truth test set. Our analysis reveals that only a small fraction of SAM-annotated data is sufficient to achieve high detection accuracy, proving the feasibility of automated annotation at scale. These findings suggest that foundation models show promise for generating training data in cattle detection pipelines under controlled conditions, potentially reducing annotation costs and supporting scalable deployment of monitoring systems. The EMA dataset and trained models are publicly available to support further research in precision livestock farming.Keywords
Funding Information
- NextGenerationEU (NPOO.C3.2.R3-I1.04.0141)
This publication has 18 references indexed in Scilit:
- Holstein-Friesian re-identification using multiple cameras and self-supervision on a working farmComputers and Electronics in Agriculture, 2025
- Evaluating model generalization for cow detection in free-stall barn settings: Insights from the COw LOcalization (COLO) datasetSmart Agricultural Technology, 2025
- Semi-automated annotation for video-based beef cattle behavior recognitionScientific Reports, 2025
- AI-powered cow detection in complex farm environmentsSmart Agricultural Technology, 2025
- Computer vision algorithms to help decision-making in cattle productionAnimal Frontiers, 2024
- A new dataset for video-based cow behavior recognitionScientific Reports, 2024
- Towards more reliable evaluation in pedestrian detection by rethinking “ignore regions”Visual Intelligence, 2024
- Utilizing 2D-region-based CNNs for automatic dendritic spine detection in 3D live cell imagingScientific Reports, 2023
- Using human pose information for handgun detectionNeural Computing and Applications, 2021
- Visual identification of individual Holstein-Friesian cattle via deep metric learningComputers and Electronics in Agriculture, 2021