DfTrack: Deconfused Data Association Framework for Multi-Object Tracking
Authors:
- 20 May 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 35 (10) , 10367-10381
Abstract
Accurate data association plays a crucial role in Multi-Object Tracking (MOT) as it helps reduce confusion such as identity switches and assignment errors. However, many existing advanced methods often overlook the diversity among trajectories and the ambiguity and conflicts present in various types of cues. Consequently, when performing simple global data association, confusion arises between detections, trajectories, and associations. To address this problem, we propose a simple, versatile, and highly interpretable Deconfused Data Association Framework (DDAF). DDAF decomposes the traditional association problem into multiple sub-problems using a series of non-learnable modules, and selectively resolves confusion in each sub-problem by strategically utilizing new cues. Building upon DDAF, we design a powerful multi-object tracker named DfTrack, which specifically targets confusion in MOT. Furthermore, we discuss different specific implementations of DDAF to tackle challenging environments characterized by low frame rate, camera motion, and cross-domain scenarios. Correspondingly, we also develop several variants of DfTrack, demonstrating the remarkable scalability and adaptability of DDAF. Extensive experiments conducted on the MOT17, MOT20, and DanceTrack datasets demonstrate that DDAF significantly outperforms simple global association methods, and its variants can adapt to various challenging environments. Furthermore, DfTrack achieves state-of-the-art performance on multiple datasets, with HOTA of 65.2%, 63.9%, and 64.4% on MOT17, MOT20, and DanceTrack, respectively. The DfTrack-Hybrid variant further improves the performance on this basis. These results validate that our DDAF can effectively decompose and resolve various confusion in global association without any learning cost.Keywords
Funding Information
- National Natural Science Foundation of China (62476104)
This publication has 39 references indexed in Scilit:
- Spatiotemporal adaptive attention 3D multiobject tracking for autonomous drivingKnowledge-Based Systems, 2023
- MOTR: End-to-End Multiple-Object Tracking with Transformer2022
- ByteTrack: Multi-object Tracking by Associating Every Detection Box2022
- TrackFormer: Multi-Object Tracking with Transformers2022
- Global Tracking Transformers2022
- MeMOT: Multi-Object Tracking with Memory2022
- FairMOT: On the Fairness of Detection and Re-identification in Multiple Object TrackingInternational Journal of Computer Vision, 2021
- Tracking Objects as Points2020
- HOTA: A Higher Order Metric for Evaluating Multi-object TrackingInternational Journal of Computer Vision, 2020
- Performance Measures and a Data Set for Multi-target, Multi-camera Tracking2016