Structured Bird’s-Eye-View Traffic Scene Understanding from Onboard Images
Authors:
- 1 October 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 15641-15650
Abstract
Autonomous navigation requires structured representation of the road network and instance-wise identification of the other traffic agents. Since the traffic scene is defined on the ground plane, this corresponds to scene understanding in the bird’s-eye-view (BEV). However, the onboard cameras of autonomous cars are customarily mounted horizontally for a better view of the surrounding, making this task very challenging. In this work, we study the problem of extracting a directed graph representing the local road network in BEV coordinates, from a single onboard camera image. Moreover, we show that the method can be extended to detect dynamic objects on the BEV plane. The semantics, locations, and orientations of the detected objects together with the road graph facilitates a comprehensive understanding of the scene. Such understanding becomes fundamental for the downstream tasks, such as path planning and navigation. We validate our approach against powerful baselines and show that our network achieves superior performance. We also demonstrate the effects of various design choices through ablation studies. Code: https://github.com/ybarancan/STSUKeywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Monocular Semantic Occupancy Grid Mapping With Convolutional Variational Encoder–Decoder NetworksIEEE Robotics and Automation Letters, 2019
- End-to-End Deep Structured Models for Drawing Crosswalks2018
- Focal Loss for Dense Object DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- Hierarchical Recurrent Attention Networks for Structured Online Maps2018
- Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++2018
- Mask R-CNN2017
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- The Cityscapes Dataset for Semantic Urban Scene Understanding2016
- Autonomous Driving in the iCity—HD Maps as a Key Challenge of the Automotive IndustryEngineering, 2016
- Remote Sensing Digital Image Analysis1999