Monocular Plan View Networks for Autonomous Driving
Authors:
- 1 November 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2876-2883
Abstract
Convolutions on monocular dash cam videos capture spatial invariances in the image plane but do not explicitly reason about distances and depth. We propose a simple transformation of observations into a bird’s eye view, also known as plan view, for end-to-end control. We detect vehicles and pedestrians in the first person view and project them into an overhead plan view. This representation provides an abstraction of the environment from which a deep network can easily deduce the positions and directions of entities. Additionally, the plan view enables us to leverage advances in 3D object detection in conjunction with deep policy learning. We evaluate our monocular plan view network on the photo-realistic Grand Theft Auto V simulator. A network using both a plan view and front view causes less than half as many collisions as previous detection-based methods and an order of magnitude fewer collisions than pure pixel-based policies.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- End-to-End Learning of Driving Models from Large-Scale Video Datasets2017
- Multi-view 3D Object Detection Network for Autonomous Driving2017
- 3D Bounding Box Estimation Using Deep Learning and Geometry2017
- Deep tracking in the wild: End-to-end tracking using recurrent neural networksThe International Journal of Robotics Research, 2017
- Subcategory-Aware Convolutional Neural Networks for Object Proposals and Detection2017
- Monocular 3D Object Detection for Autonomous Driving2016
- DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving2015
- A coarse-to-fine model for 3D pose estimation and sub-category recognition2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Model Based Vehicle Tracking for Autonomous Driving in Urban Environments2008