HINTED: Hard Instance Enhanced Detector with Mixed-Density Feature Fusion for Sparsely-Supervised 3D Object Detection
Authors:
- 16 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 15321-15330
Abstract
Current sparsely-supervised object detection methods largely depend on high threshold settings to derive high-quality pseudo labels from detector predictions. However, hard instances within point clouds frequently display incomplete structures, causing decreased confidence scores in their assigned pseudo-labels. Previous methods inevitably result in inadequate positive supervision for these instances. To address this problem, we propose a novel Hard INsTance Enhanced Detector (HINTED), for sparsely-supervised 3D object detection. Firstly, we design a self-boosting teacher (SBT) model to generate more potential pseudo-labels, enhancing the effectiveness of information transfer. Then, we introduce a mixed-density student (MDS) model to concentrate on hard instances during the training phase, thereby improving detection accuracy. Our extensive experiments on the KITTI dataset validate our method's superior performance. Compared with leading sparsely-supervised methods, HINTED significantly improves the detection performance on hard instances, no-tably outperforming fully-supervised methods in detecting challenging categories like cyclists. HINTED also significantly outperforms the state-of-the-art semi-supervised method on challenging categories. The code is available at https://github.com/xmuqimingxia/HINTED.Keywords
Funding Information
- National Natural Science Foundation of China (62171393)
- Fundamental Research Funds for the Central Universitirs (20720220064)
This publication has 34 references indexed in Scilit:
- 3D Object Detection for Autonomous Driving: A Comprehensive SurveyInternational Journal of Computer Vision, 2023
- PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object DetectionInternational Journal of Computer Vision, 2022
- DetMatch: Two Teachers are Better than One for Joint 2D and 3D Semi-Supervised Object Detection2022
- PseudoAugment: Learning to Use Unlabeled Data for Data Augmentation in Point Clouds2022
- CenterFormer: Center-Based Transformer for 3D Object Detection2022
- Semi-supervised 3D Object Detection with Proficient Teachers2022
- Weakly Supervised 3D Object Detection from Lidar Point Cloud2020
- Squeeze-and-Excitation Networks2018
- PIXOR: Real-time 3D Object Detection from Point Clouds2018
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012