T-RODNet: Transformer for Vehicular Millimeter-Wave Radar Object Detection
- 15 December 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 72 (00189456) , 1-12
Abstract
Environmental perception technology is key to self-driving. Nowadays, this is mostly conducted using cameras and Lidar, despite their poor immunity to interference and high price. The millimeter-wave radar can solve these problems, but the current radar-based models suffer from over-complexity and poor global modeling capability. Moreover, the anti-interference capability of millimeter-wave radar object detection (ROD) techniques in complex environments is also a major challenge. Considering this, this paper proposes a novel model called Transformer ROD network (T-RODNet), which consists of a convolutional neural network (CNN) and Transformer, aiming to simultaneously utilize the ability of both to acquire local and global features. In order to improve the modeling capability of the encoder and decoder, the DAM and T-W/SW-MSA modules are proposed, which can greatly improve the performance of the model. Experiments show that T-RODNet achieves state-of-the-art (SOTA) performance on both CRUW and CARRADA datasets. The GFLOPs of T-RODNet are only 8.5% of RODNet-HG, but the Average Precision (AP) is 3.84 higher. Besides, T-RODNet also achieves a strong resistance to interference on the CRUW dataset with noise added. Our code is available at: https://github.com/Zhuanglong2/T-RODNet.Keywords
Funding Information
- National Natural Science Foundation of China (61971002)
- Natural Science Foundation of Anhui Province (2008085MF185, 1608085MF135)
This publication has 32 references indexed in Scilit:
- RAMP-CNN: A Novel Neural Network for Enhanced Automotive Radar Object RecognitionIEEE Sensors Journal, 2020
- End-to-End Object Detection with Transformers2020
- Millimeter-Wave Array Radar-Based Human Gait Recognition Using Multi-Channel Three-Dimensional Convolutional Neural NetworkSensors, 2020
- Group Normalization2018
- Road Targets Recognition Based on Deep Learning and Micro-Doppler Features2018
- Practical classification of different moving targets using automotive radar and deep neural networksIET Radar, Sonar & Navigation, 2018
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Fully convolutional networks for semantic segmentation2015
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Long Short-Term MemoryNeural Computation, 1997