An AIoT Monitoring System for Multi-Object Tracking and Alerting
Authors:
- Wonseok JungWJWonseok Jung
- Se-Han KimSKSe-Han Kim
- Seng-Phil HongSHSeng-Phil Hong
- Jeongwook SeoJeongwook Seo
Open Access
- 1 January 2021
- journal article
- research article
- Published by Tech Science Press in Computers, Materials & Continua
- Vol. 67 (1) , 337-348
Abstract
Pig farmers want to have an effective solution for automatically detecting and tracking multiple pigs and alerting their conditions in order to recognize disease risk factors quickly. In this paper, therefore, we propose a novel monitoring system using an Artificial Intelligence of Things (AIoT) technique combining artificial intelligence and Internet of Things (IoT). The proposed system consists of AIoT edge devices and a central monitoring server. First, an AIoT edge device extracts video frame images from a CCTV camera installed in a pig pen by a frame extraction method, detects multiple pigs in the images by a faster region-based convolutional neural network (RCNN) model, and tracks them by an object center-point tracking algorithm (OCTA) based on bounding box regression outputs of the faster RCNN. Finally, it sends multi-pig tracking images to the central monitoring server, which alerts them to pig farmers through a social networking service (SNS) agent in cooperation with an oneM2M-compliant IoT alerting method. Experimental results showed that the multi-pig tracking method achieved the multi-object tracking accuracy performance of about 77%. In addition, we verified alerting operation by confirming the images received in the SNS smartphone application.Keywords
This publication has 16 references indexed in Scilit:
- Multi-Pig Part Detection and Association with a Fully-Convolutional NetworkSensors, 2019
- A Novel Edge Detection Method Based on the Regularized Laplacian OperationSymmetry, 2018
- Multi-object extraction from topview group-housed pig images based on adaptive partitioning and multilevel thresholding segmentationBiosystems Engineering, 2015
- Observer bias in animal behaviour research: can we believe what we score, if we score what we believe?Animal Behaviour, 2014
- Development of a real-time computer vision system for tracking loose-housed pigsComputers and Electronics in Agriculture, 2011
- Foot and Mouth Disease : Etiology, Epidemiology and Control MeasuresInfection & Chemotherapy, 2011
- Detecting new and emerging diseases on livestock farms using an early detection systemEpidemiology and Infection, 2010
- Splitting touching cells based on concave points and ellipse fittingPattern Recognition, 2009
- Challenges in the design of a GNSS ear tag for feedlot cattleComputers and Electronics in Agriculture, 2009
- Evaluating Multiple Object Tracking Performance: The CLEAR MOT MetricsEURASIP Journal on Image and Video Processing, 2008