Pseudo-LiDAR-Based Road Detection
- 24 January 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 32 (8) , 5386-5398
Abstract
Road detection is a critically important task for self-driving cars. By employing LiDAR data, recent works have significantly improved the accuracy of road detection. However, relying on LiDAR sensors limits the application of those methods when only cameras are available. In this paper, we propose a novel road detection approach with RGB images being the only input. Specifically, we exploit pseudo-LiDAR using depth estimation and propose a feature fusion network in which RGB images and learned depth information are fused for improved road detection. To optimize the network architecture and improve the efficiency of our network, we propose a method to search for the information propagation paths. Finally, to reduce the computational cost, we design a modality distillation strategy to avoid using depth estimation networks during inference. The resulting model eliminates the reliance on LiDAR sensors and achieves state-of-the-art performance on two challenging benchmarks, KITTI and R2D.Keywords
All Related Versions
This publication has 56 references indexed in Scilit:
- Deep Residual Learning for Image Recognition2016
- Fully convolutional networks for semantic segmentation2015
- Deep learningNature, 2015
- On Enhancing Lane Estimation Using Contextual CuesIEEE Transactions on Circuits and Systems for Video Technology, 2015
- Combining Priors, Appearance, and Context for Road DetectionIEEE Transactions on Intelligent Transportation Systems, 2014
- A new performance measure and evaluation benchmark for road detection algorithms2013
- Road Detection Based on Illuminant InvarianceIEEE Transactions on Intelligent Transportation Systems, 2010
- The relationship between Precision-Recall and ROC curves2006
- Color-based road detection in urban traffic scenesIEEE Transactions on Intelligent Transportation Systems, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004