Multiview Monitoring of Individual Cattle Behavior Based on Action Recognition in Closed Barns Using Deep Learning
Open Access
Abstract
Cattle behavior recognition is essential for monitoring their health and welfare. Existing techniques for behavior recognition in closed barns typically rely on direct observation to detect changes using wearable devices or surveillance cameras. While promising progress has been made in this field, monitoring individual cattle, especially those with similar visual characteristics, remains challenging due to numerous factors such as occlusion, scale variations, and pose changes. Accurate and consistent individual identification over time is therefore essential to overcome these challenges. To address this issue, this paper introduces an approach for multiview monitoring of individual cattle behavior based on action recognition using video data. The proposed system takes an image sequence as input and utilizes a detector to identify hierarchical actions categorized as part and individual actions. These regions of interest are then inputted into a tracking and identification mechanism, enabling the system to continuously track each individual in the scene and assign them a unique identification number. By implementing this approach, cattle behavior is continuously monitored, and statistical analysis is conducted to assess changes in behavior in the time domain. The effectiveness of the proposed framework is demonstrated through quantitative and qualitative experimental results obtained from our Hanwoo cattle video database. Overall, this study tackles the challenges encountered in real farm indoor scenarios, capturing spatiotemporal information and enabling automatic recognition of cattle behavior for precision livestock farming.Keywords
Funding Information
- National Research Foundation of Korea (2019R1A6A1A09031717, 1545027423, 2020R1A2C2013060)
- Ministry of Agriculture, Food, and Rural Affairs (MAFRA) (2019R1A6A1A09031717, 1545027423, 2020R1A2C2013060)
- Ministry of Science and ICT (MSIT), Rural Development Administration (RDA) (2019R1A6A1A09031717, 1545027423, 2020R1A2C2013060)
- National Research Foundation of Korea (2019R1A6A1A09031717, 1545027423, 2020R1A2C2013060)
This publication has 32 references indexed in Scilit:
- Exploring the Potential of Precision Livestock Farming Technologies to Help Address Farm Animal WelfareFrontiers in Animal Science, 2021
- Graduate Student Literature Review: Evaluating the appropriate use of wearable accelerometers in research to monitor lying behaviors of dairy cowsJournal of Dairy Science, 2020
- HOTA: A Higher Order Metric for Evaluating Multi-object TrackingInternational Journal of Computer Vision, 2020
- Deep learning-based hierarchical cattle behavior recognition with spatio-temporal informationComputers and Electronics in Agriculture, 2020
- IoT-Based Cow Health Monitoring System2020
- Automatic lameness detection in cattleThe Veterinary Journal, 2019
- Farm Animal Cognition—Linking Behavior, Welfare and EthicsFrontiers in Veterinary Science, 2019
- Cattle behaviour classification from collar, halter, and ear tag sensorsInformation Processing in Agriculture, 2018
- Simple online and realtime tracking with a deep association metric2017
- Simple online and realtime tracking2016