High Resolution Point Clouds from mmWave Radar
Authors:
- Akarsh PrabhakaraAPAkarsh Prabhakara
- Tao JinTJTao Jin
- Arnav DasADArnav Das
- Gantavya BhattGBGantavya Bhatt
- Lilly KumariLKLilly Kumari
- Elahe SoltanaghaeiESElahe Soltanaghaei
- Jeff BilmesJBJeff Bilmes
- Swarun KumarSKSwarun Kumar
- Anthony RoweARAnthony Rowe
Preprint
Abstract
This paper explores a machine learning approach for generating high resolution point clouds from a single-chip mmWave radar. Unlike lidar and vision-based systems, mmWave radar can operate in harsh environments and see through occlusions like smoke, fog, and dust. Unfortunately, current mmWave processing techniques offer poor spatial resolution compared to lidar point clouds. This paper presents RadarHD, an end-to-end neural network that constructs lidar-like point clouds from low resolution radar input. Enhancing radar images is challenging due to the presence of specular and spurious reflections. Radar data also doesn't map well to traditional image processing techniques due to the signal's sinc-like spreading pattern. We overcome these challenges by training RadarHD on a large volume of raw I/Q radar data paired with lidar point clouds across diverse indoor settings. Our experiments show the ability to generate rich point clouds even in scenes unobserved during training and in the presence of heavy smoke occlusion. Further, RadarHD's point clouds are high-quality enough to work with existing lidar odometry and mapping workflows.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- 3D ego-Motion Estimation Using low-Cost mmWave Radars via Radar Velocity Factor for Pose-Graph SLAMIEEE Robotics and Automation Letters, 2021
- Milli-RIO: Ego-Motion Estimation With Low-Cost Millimetre-Wave RadarIEEE Sensors Journal, 2020
- Near-Field MIMO-SAR Millimeter-Wave Imaging With Sparsely Sampled Aperture DataIEEE Access, 2019
- Passive Millimeter Wave Imaging System Based on Helical ScanningScientific Reports, 2018
- Experimental Analysis of Radar Odometry by Commercial Ultralight Radar Sensor for Miniaturized UASJournal of Intelligent & Robotic Systems, 2017
- Radar odometry on fixed-wing small unmanned aircraftIEEE Transactions on Aerospace and Electronic Systems, 2016
- Evaluation of Navigation Sensors in Fire Smoke EnvironmentsFire Technology, 2013
- Millimeter-Wave and Submillimeter-Wave Imaging for Security and SurveillanceProceedings of the IEEE, 2007
- 3D velocity from 3D Doppler radial velocityInternational Journal of Imaging Systems and Technology, 2005
- Bilinear interpolation of digital imagesUltramicroscopy, 1981