Complexer-YOLO: Real-Time 3D Object Detection and Tracking on Semantic Point Clouds
Authors:
Top Cited Papers
- 1 June 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1190-1199
Abstract
Accurate detection of 3D objects is a fundamental problem in computer vision and has an enormous impact on autonomous cars, augmented/virtual reality and many applications in robotics. In this work we present a novel fusion of neural network based state-of-the-art 3D detector and visual semantic segmentation in the context of autonomous driving. Additionally, we introduce Scale-Rotation-Translation score (SRTs), a fast and highly parameterizable evaluation metric for comparison of object detections, which speeds up our inference time up to 20% and halves training time. On top, we apply state-of-the-art online multi target feature tracking on the object measurements to further increase accuracy and robustness utilizing temporal information. Our experiments on KITTI show that we achieve same results as state-of-the-art in all related categories, while maintaining the performance and accuracy trade-off and still run in real-time. Furthermore, our model is the first one that fuses visual semantic with 3D object detection.Keywords
All Related Versions
This publication has 38 references indexed in Scilit:
- ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic SegmentationIEEE Transactions on Intelligent Transportation Systems, 2017
- Focal Loss for Dense Object Detection2017
- Mask R-CNN2017
- Multi-view 3D Object Detection Network for Autonomous Driving2017
- RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation2017
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- The Cityscapes Dataset for Semantic Urban Scene Understanding2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Learning Spatiotemporal Features with 3D Convolutional Networks2015
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012