Lightweight 3D Multi-Object Tracking via Collaborative Camera and LiDAR Sensors
Open Access
Abstract
With the widespread adoption of camera and LiDAR sensors, 3D multi-object tracking (MOT) technology has been extensively applied across numerous fields such as robotics, autonomous driving, and surveillance. However, existing 3D MOT methods still face significant challenges in addressing issues such as false detections, ghost trajectories, incorrect associations, and identity switches. To address these challenges, we propose a lightweight 3D multi-object tracking framework via collaborative camera and LiDAR sensors. Firstly, we design a confidence inverse normalization guided ghost trajectories suppression module (CIGTS). This module suppresses false detections and ghost trajectories at their source using inverse normalization and a virtual trajectory survival frame strategy. Secondly, an adaptive matching space-driven lightweight association module (AMSLA) is proposed. By discarding global association strategies, this module improves association efficiency and accuracy using low-cost decision factors. Finally, a multi-factor collaborative perception-based intelligent trajectory management module (MFCTM) is constructed. This module enables accurate retention or deletion decisions for unmatched trajectories, thereby reducing computational overhead and the risk of identity mismatches. Extensive experiments on the KITTI dataset show that the proposed method outperforms state-of-the-art methods across multiple performance metrics, achieving Higher Order Tracking Accuracy (HOTA) scores of 80.13% and 53.24% for the Car and Pedestrian categories, respectively.Keywords
Funding Information
- Key Research and Development Program of Shandong (2024CXGC010110)
This publication has 38 references indexed in Scilit:
- Learning data association for multi-object tracking using only coordinatesPattern Recognition, 2024
- APPTracker+: Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object TrackingInternational Journal of Computer Vision, 2024
- 3D multi-object tracking based on informatic divergence-guided data associationSignal Processing, 2024
- CollabMOT Stereo Camera Collaborative Multi Object TrackingIEEE Access, 2024
- 3D multi-object tracking with boosting data association and improved trajectory management mechanismSignal Processing, 2023
- ShaSTA: Modeling Shape and Spatio-Temporal Affinities for 3D Multi-Object TrackingIEEE Robotics and Automation Letters, 2023
- StrongFusionMOT: A Multi-Object Tracking Method Based on LiDAR-Camera FusionIEEE Sensors Journal, 2022
- DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion With Deep AssociationIEEE Robotics and Automation Letters, 2022
- A Fast and High-Performance Object Proposal Method for Vision Sensors: Application to Object DetectionIEEE Sensors Journal, 2022
- HOTA: A Higher Order Metric for Evaluating Multi-object TrackingInternational Journal of Computer Vision, 2020