Probabilistic End-to-End Vehicle Navigation in Complex Dynamic Environments with Multimodal Sensor Fusion
- 11 May 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. PP (3) , 1
Abstract
All-day and all-weather navigation is a critical capability for autonomous driving, which requires proper reaction to varied environmental conditions and complex agent behaviors. Recently, with the rise of deep learning, end-to-end control for autonomous vehicles has been studied a lot. However, most works are solely based on visual information, which could be degraded by challenging illumination conditions, such as dim lights or total darkness. In addition, they usually generate and apply deterministic control commands without considering the uncertainties in the future. In this paper, based on imitation learning, we propose a probabilistic driving model with multi-perception capability utilizing the information from camera, lidar and radar. We further evaluate its driving performance on-line on our new driving benchmark, which includes various environments (urban and rural areas, weathers, time of day, etc) and dynamic obstacles (vehicles, pedestrians, motorcyclists, bicyclists, etc). The results suggest that our proposed model outperforms baselines and achieves excellent generalization performance in unseen environments with heavy traffic and extreme weather conditions.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Deep Local Trajectory Replanning and Control for Robot Navigation2019
- On Offline Evaluation of Vision-Based Driving Models2018
- End-to-End Learning of Driving Models with Surround-View Cameras and Route Planners2018
- End-to-End Driving Via Conditional Imitation Learning2018
- End-to-End Learning of Driving Models from Large-Scale Video Datasets2017
- From perception to decision: A data-driven approach to end-to-end motion planning for autonomous ground robots2017
- Deep Residual Learning for Image Recognition2016
- Probabilistic trajectory prediction with Gaussian mixture models2012
- A perception‐driven autonomous urban vehicleJournal of Field Robotics, 2008
- The development of machine vision for road vehicles in the last decade2003