ARC: Automotive Radar Consistency Regularization for Semi-Supervised Learning
- 22 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 9 (9) , 5889-5904
Abstract
In recent years, radar has become a crucial part of road scene perception. In particular, radar increases sensing reliability in poor weather and lighting conditions. State-of-the-art deep learning methods require training, but the labeling of radar data needed to generate the required “ground truth” is time-consuming and requires expert knowledge, due to the confusing nature of radar signals. This limits the development of accurate radar models. To address the difficulty of annotating radar datasets, we propose a novel semi-supervised learning framework we call Automotive Radar Consistency (ARC), which enables the inclusion of unlabeled radar frames during training. This improves performance without adding manual labor. Our model learns object features based on micro-Doppler signatures from a time series of radar frames. We posit that the same object in both the forward and reverse temporal directions will share similar features, and we use this as a consistency regularization to encourage the model to learn how to distinguish targets. In addition, we propose Focal JS-divergence to alleviate over-fitting and address the class imbalance problem in semi-supervised learning, by focusing on the hard classes and samples in the unlabeled data. Our proposed method is a general training strategy that can be incorporated in most existing deep learning frameworks. Our experimental results on two public datasets with limited annotations show that our method significantly improves the performance of existing supervised methods. Under the same network architecture, our method outperforms the fully supervised method in object detection by as much as 36%.Keywords
Funding Information
- EU Horizon 2020 ECSEL JU Research and Innovation Programme (876487)
- Vlaamse regering
This publication has 43 references indexed in Scilit:
- An automated driving systems data acquisition and analytics platformTransportation Research Part C: Emerging Technologies, 2023
- Radatron: Accurate Detection Using Multi-resolution Cascaded MIMO Radar2022
- mmGesture: Semi-supervised gesture recognition system using mmWave radarExpert Systems with Applications, 2022
- Consistency regularization teacher–student semi-supervised learning method for target recognition in SAR imagesThe Visual Computer, 2021
- RadarNet: Exploiting Radar for Robust Perception of Dynamic Objects2020
- Label Propagation for Deep Semi-Supervised Learning2019
- Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification2018
- Deep Co-Training for Semi-Supervised Image Recognition2018
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Fully convolutional networks for semantic segmentation2015