SORT-YM: An Algorithm of Multi-Object Tracking with YOLOv4-Tiny and Motion Prediction
Open Access
- 21 September 2021
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 10 (18) , 2319
Abstract
Multi-object tracking (MOT) is a significant and widespread research field in image processing and computer vision. The goal of the MOT task consists in predicting the complete tracklets of multiple objects in a video sequence. There are usually many challenges that degrade the performance of the algorithm in the tracking process, such as occlusion and similar objects. However, the existing MOT algorithms based on the tracking-by-detection paradigm struggle to accurately predict the location of the objects that they fail to track in complex scenes, leading to tracking performance decay, such as an increase in the number of ID switches and tracking drifts. To tackle those difficulties, in this study, we design a motion prediction strategy for predicting the location of occluded objects. Since the occluded objects may be legible in earlier frames, we utilize the speed and location of the objects in the past frames to predict the possible location of the occluded objects. In addition, to improve the tracking speed and further enhance the tracking robustness, we utilize efficient YOLOv4-tiny to produce the detections in the proposed algorithm. By using YOLOv4-tiny, the tracking speed of our proposed method improved significantly. The experimental results on two widely used public datasets show that our proposed approach has obvious advantages in tracking accuracy and speed compared with other comparison algorithms. Compared to the Deep SORT baseline, our proposed method has a significant improvement in tracking performance.Keywords
This publication has 49 references indexed in Scilit:
- Multiple Hypothesis Tracking Revisited2015
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Robust Online Multi-object Tracking Based on Tracklet Confidence and Online Discriminative Appearance Learning2014
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- 3D Traffic Scene Understanding From Movable PlatformsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- The Hungarian method for the assignment problemNaval Research Logistics (NRL), 2004
- Sonar tracking of multiple targets using joint probabilistic data associationIEEE Journal of Oceanic Engineering, 1983
- An algorithm for tracking multiple targetsIEEE Transactions on Automatic Control, 1979
- A New Approach to Linear Filtering and Prediction ProblemsJournal of Basic Engineering, 1960