Scene Understanding With Automotive Radar
- 25 November 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 5 (2) , 188-203
Abstract
Extracting semantic information solely from automotive radar data is a relatively new topic in the radar community. We present a complete pipeline to obtain semantic information for each target measured by a network of radar sensors. Static and dynamic objects are treated in two separate branches: In the first branch, a convolutional neural network performs semantic segmentation on radar grid maps of the static environment. In the second branch, a novel neural network architecture is used for recurrent instance segmentation on radar point clouds of moving objects. The class probabilities assigned to each cell in the grid map are mapped back to the radar targets in this spatial region so that in a merging step the results from the two classifiers can be combined into one point cloud. In addition to a novel network structure for recurrent instance segmentation of point clouds, we also present a new set of layers for radar grid maps which are beneficial for semantic segmentation tasks and we develop a weighting scheme for the network's loss function to account for the data integration process in grid maps. We evaluate our approaches on large data sets and we display that they outperform previously proposed methods.Keywords
This publication has 30 references indexed in Scilit:
- Gait Classification of Young Adults, Elderly Non-Fallers, and Elderly Fallers Using Micro-Doppler Radar Signals: Simulation StudyIEEE Sensors Journal, 2017
- Pixel-Level Encoding and Depth Layering for Instance-Level Semantic Labeling2016
- Potential of radar for static object classification using deep learning methods2016
- VoxNet: A 3D Convolutional Neural Network for real-time object recognition2015
- Making Bertha See Even More: Radar ContributionIEEE Access, 2015
- Radar Sensing for Intelligent Vehicles in Urban EnvironmentsSensors, 2015
- Going deeper with convolutions2015
- Fully convolutional networks for semantic segmentation2015
- Detection of arbitrarily rotated parked cars based on radar sensors2015
- Pedestrian classification in automotive radar systems2012