AdaptiveShape: Solving Shape Variability for 3D Object Detection with Geometry Aware Anchor Distributions
Preprint
Abstract
3D object detection with point clouds and images plays an important role in perception tasks such as autonomous driving. Current methods show great performance on detection and pose estimation of standard-shaped vehicles but lack behind on more complex shapes as e.g. semi-trailer truck combinations. Determining the shape and motion of those special vehicles accurately is crucial in yard operation and maneuvering and industrial automation applications. This work introduces several new methods to improve and measure the performance for such classes. State-of-the-art methods are based on predefined anchor grids or heatmaps for ground truth targets. However, the underlying representations do not take the shape of different sized objects into account. Our main contribution, AdaptiveShape, uses shape aware anchor distributions and heatmaps to improve the detection capabilities. For large vehicles we achieve +10.9% AP in comparison to current shape agnostic methods. Furthermore we introduce a new fast LiDAR-camera fusion. It is based on 2D bounding box camera detections which are available in many processing pipelines. This fusion method does not rely on perfectly calibrated or temporally synchronized systems and is therefore applicable to a broad range of robotic applications. We extend a standard point pillar network to account for temporal data and improve learning of complex object movements. In addition we extended a ground truth augmentation to use grouped object pairs to further improve truck AP by +2.2% compared to conventional augmentation.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- CenterFormer: Center-Based Transformer for 3D Object Detection2022
- Pillar-Based Object Detection for Autonomous Driving2020
- Learning From Multiple Experts: Self-paced Knowledge Distillation for Long-Tailed Classification2020
- nuScenes: A Multimodal Dataset for Autonomous Driving2020
- Scalability in Perception for Autonomous Driving: Waymo Open Dataset2020
- PointPainting: Sequential Fusion for 3D Object Detection2020
- CornerNet: Detecting Objects as Paired KeypointsInternational Journal of Computer Vision, 2019
- PointPillars: Fast Encoders for Object Detection From Point Clouds2019
- Frustum PointNets for 3D Object Detection from RGB-D Data2018
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection2018