ARTrackV2: Prompting Autoregressive Tracker Where to Look and How to Describe
Top Cited Papers
- 16 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 19048-19057
Abstract
We present ARTrackV2, which integrates two pivotal aspects of tracking: determining where to look (localization) and how to describe (appearance analysis) the target object across video frames. Building on the foundation of its predecessor, ARTrackV2 extends the concept by introducing a unified generative framework to “read out” object's trajectory and “retell” its appearance in an autoregressive manner. This approach fosters a time-continuous methodology that models the joint evolution of motion and visual features, guided by previous estimates. Furthermore, ARTrackV2 stands out for its efficiency and simplicity, obviating the less efficient intra-frame autoregression and hand-tuned parameters for appearance updates. Despite its simplicity, ARTrackV2 achieves state-of-the-art performance on prevailing benchmark datasets while demonstrating a remarkable efficiency improvement. In particular, ARTrackV2 achieves an AO score of 79. 5% on GOT-10k and an AUC of 86. 1% on TrackingNet while being 3.6× faster than ARTrack.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (U21B2048)
- Fundamental Research Funds for the Central Universities (xxj032023020)
This publication has 55 references indexed in Scilit:
- MOTR: End-to-End Multiple-Object Tracking with Transformer2022
- Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework2022
- Towards Sequence-Level Training for Visual Tracking2022
- Backbone is All Your Need: A Simplified Architecture for Visual Object Tracking2022
- Ocean: Object-Aware Anchor-Free Tracking2020
- Unveiling the Power of Deep Tracking2018
- TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild2018
- Distractor-Aware Siamese Networks for Visual Object Tracking2018
- Learning Dynamic Memory Networks for Object Tracking2018
- Microsoft COCO: Common Objects in Context2014