Learning on Multistatic Simulation Data for Radar-Based Automotive Gesture Recognition
- 5 September 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Microwave Theory and Techniques
- Vol. 70 (11) , 5039-5050
Abstract
Radar-based gesture recognition can play a vital role in autonomous vehicles’ interaction with vulnerable road users (VRUs). However, in automotive scenarios the same gesture produces strongly differing radar responses owing to the wide range of variations such as position, orientation, or ego-motion. Since including all kinds of modifications in a measured dataset is laborious, gesture simulations alleviate the measurement effort and increase the robustness against edge and corner cases. Hence, this article presents a flexible geometric human target model allowing the direct introduction of a wide range of modifications, while it facilitates the handling of shadowing effects and multiradar constellations. Using the proposed simulation model, a dataset recorded with a radar sensor network consisting of three chirp sequence (CS) radars is resimulated based on the motion data simultaneously captured with a stereo video system. Completely substituting the measured by the simulated data for training, a convolutional neural network (CNN) classifier still achieves 80.4% cross-validation accuracy on a challenging gesture set, compared with 89.4% for training on the measured data. Moreover, using the simulated data the classifier is shown to successfully generalize to new scenarios not observed in measurements.Keywords
Funding Information
- Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg
- Ministerium für Verkehr Baden-Württemberg as part of the Project INTUITIVER
This publication has 27 references indexed in Scilit:
- Hand Keypoint Detection in Single Images Using Multiview Bootstrapping2017
- Interacting with Soli2016
- Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural NetworkIEEE Access, 2016
- SoliACM Transactions on Graphics, 2016
- Looking at Humans in the Age of Self-Driving and Highly Automated VehiclesIEEE Transactions on Intelligent Vehicles, 2016
- Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural NetworksIEEE Geoscience and Remote Sensing Letters, 2015
- A kinect-based human micro-doppler simulatorIEEE Aerospace and Electronic Systems Magazine, 2015
- Microdoppler signature simulation of computer animated human and animal motions2008
- A method for registration of 3-D shapesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
- Radar cross-section estimation for simple shapesProceedings of the IEEE, 1965