High Resolution Point Clouds from mmWave Radar
Authors:
Top Cited Papers
- 29 May 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4135-4142
Abstract
This paper explores a machine learning approach on data from a single-chip mmWave radar for generating high resolution point clouds – a key sensing primitive for robotic applications such as mapping, odometry and localization. Unlike lidar and vision-based systems, mmWave radar can operate in harsh environments and see through occlusions like smoke, fog, and dust. Unfortunately, current mmWave processing techniques offer poor spatial resolution compared to lidar point clouds. This paper presents RadarHD, an end-to-end neural network that constructs lidar-like point clouds from low resolution radar input. Enhancing radar images is challenging due to the presence of specular and spurious reflections. Radar data also doesn't map well to traditional image processing techniques due to the signal's sinc-like spreading pattern. We overcome these challenges by training RadarHD on a large volume of raw I/Q radar data paired with lidar point clouds across diverse indoor settings. Our experiments show the ability to generate rich point clouds even in scenes unobserved during training and in the presence of heavy smoke occlusion. Further, RadarHD's point clouds are high-quality enough to work with existing lidar odometry and mapping workflows.Keywords
All Related Versions
Funding Information
- NSF (2030154,2106921,2007786,1942902,2111751)
- Bosch
- ARL
This publication has 59 references indexed in Scilit:
- Capturing the human figure through a wallACM Transactions on Graphics, 2015
- mTrack2015
- Personal Mobile Radars with Millimeter-Wave Massive Arrays for Indoor MappingIEEE Transactions on Mobile Computing, 2015
- 60 GHz synthetic aperture radar for short-range imaging: Theory and experiments2014
- Evaluation of Navigation Sensors in Fire Smoke EnvironmentsFire Technology, 2013
- Localization and Mapping Using Only a Rotating FMCW Radar SensorSensors, 2013
- Radar SLAM using visual featuresEURASIP Journal on Advances in Signal Processing, 2011
- Motion compensation errors: effects on the accuracy of airborne SAR imagesIEEE Transactions on Aerospace and Electronic Systems, 2005
- 3D velocity from 3D Doppler radial velocityInternational Journal of Imaging Systems and Technology, 2005
- Bilinear interpolation of digital imagesUltramicroscopy, 1981