Monocular 3D Vehicle Detection Based on Video Point Tracking: A Novel Approach Without Prior Information
- 13 August 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 26 (11) , 21172-21185
Abstract
Monocular vision systems have emerged as a promising solution for 3D object detection due to their cost-effectiveness and deployment simplicity. However, existing methods heavily rely on prior information such as camera parameters and complex 3D dataset annotations. Most current approaches focus on static RGB images, struggling to recover 3D information from 2D inputs. We propose a novel monocular 3D vehicle detection method based on point tracking from a roadside perspective, leveraging dynamic inter-frame associations in video data. Our method operates without prior data like vehicle dimensions or camera parameters, and eliminates the need for complex 3D dataset construction and annotation. It integrates object detection and semantic segmentation for feature extraction, high-precision inter-frame data association, and trajectory-based state analysis. 3D reconstruction is achieved through reference point determination and coordinate calibration under geometric constraints. Experimental results on the DAIR-V2X-I dataset demonstrate superior performance over baseline models, with error reductions ranging from 1.3% to 7.3% across various metrics (A3DS, A2DS, AGS, ALS, APS, AW). This approach presents a practical solution for monocular 3D object detection while eliminating dependency on prior information and complex datasets.Keywords
Funding Information
- National Natural Science Foundation of China (52172333)
- Natural Science Foundation of Sichuan Province (2024NSFSC0175)
- Fundamental Research Funds for the Central Universities (2682024ZTPY018)
This publication has 38 references indexed in Scilit:
- CenterLoc3D: monocular 3D vehicle localization network for roadside surveillance camerasComplex & Intelligent Systems, 2023
- PETR: Position Embedding Transformation for Multi-view 3D Object Detection2022
- Lidar Point Cloud Guided Monocular 3D Object Detection2022
- BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic SegmentationInternational Journal of Computer Vision, 2021
- RTM3D: Real-Time Monocular 3D Detection from Object Keypoints for Autonomous Driving2020
- Detection of 3D bounding boxes of vehicles using perspective transformation for accurate speed measurementMachine Vision and Applications, 2020
- 3D vehicle model-based PTZ camera auto-calibration for smart global villageSustainable Cities and Society, 2019
- BiSeNet: Bilateral Segmentation Network for Real-Time Semantic Segmentation2018
- Traffic surveillance camera calibration by 3D model bounding box alignment for accurate vehicle speed measurementComputer Vision and Image Understanding, 2017
- A New Approach to Linear Filtering and Prediction Problems2009