Real-time probabilistic fusion of sparse 3D LIDAR and dense stereo
Authors:
- 1 December 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2181-2188
Abstract
Real-time 3D perception is critical for localisation, mapping, path planning and obstacle avoidance for mobile robots and autonomous vehicles. For outdoor operation in real-world environments, 3D perception is often provided by sparse 3D LIDAR scanners, which provide accurate but low-density depth maps, and dense stereo approaches, which require significant computational resources for accurate results. Here, taking advantage of the complementary error characteristics of LIDAR range sensing and dense stereo, we present a probabilistic method for fusing sparse 3D LIDAR data with stereo images to provide accurate dense depth maps and uncertainty estimates in real-time. We evaluate the method on data collected from a small urban autonomous vehicle and the KITTI dataset, providing accuracy results competitive with state-of-the-art stereo approaches and credible uncertainty estimates that do not misrepresent the true errors, and demonstrate real-time operation on a range of low-power GPU systems.Keywords
This publication has 14 references indexed in Scilit:
- Object scene flow for autonomous vehicles2015
- Displets: Resolving stereo ambiguities using object knowledge2015
- Fast LIDAR localization using multiresolution Gaussian mixture maps2015
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- KinectFusion: Real-time dense surface mapping and tracking2011
- Integrating LIDAR into Stereo for Fast and Improved Disparity Computation2011
- Autonomous driving in urban environments: Boss and the Urban ChallengeJournal of Field Robotics, 2008
- Variable baseline/resolution stereo2008
- Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extractionISPRS Journal of Photogrammetry and Remote Sensing, 2007