Multidimensional Feature Representation and Learning for Robust Hand-Gesture Recognition on Commercial Millimeter-Wave Radar
Authors:
- 31 July 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 59 (6) , 4749-4764
Abstract
This article presents a robust hand-gesture recognition method via multidimensional feature representation and learning specifically designed for commercial frequency-modulated continuous wave (FMCW) multi-input multi-output (MIMO) millimeter-wave radar. First, the optimal configuration of the radar system parameters for the hand-gesture recognition scenario is investigated and a standard procedure to determine the system configuration is given. Then a moving scattering center model is proposed to represent the 3-D point cloud in the range-Doppler (RD)-angular multidimensional feature space. A scattering point detection and tracking algorithm is presented based on a set of motion constraints in terms of position, velocity, and acceleration. It is derived from the space-time continuity of a nonrigid target. Finally, a lightweight multichannel convolutional neural network (CNN) is designed to learn and classify multidimensional gesture features including radial RD and tangential azimuth-elevation. Extensive experiments are carried out with the developed system and a large data set is obtained to train and test the classifier. The results show that the proposed gesture recognition method can effectively distinguish gestures that are easily confused in the RD domain and achieve robust performances under various conditions.Keywords
Funding Information
- National Key Research and Development Program of China (2017YFA0700203)
- Natural Science Foundation of China (61991422, 61822107)
This publication has 41 references indexed in Scilit:
- Recent advances in millimeter-wave radars2015
- Dolphin: Ultrasonic-Based Gesture Recognition on Smartphone Platform2014
- Superpixel-Based Hand Gesture Recognition With Kinect Depth CameraIEEE Transactions on Multimedia, 2014
- Dynamic Sign Language Recognition for Smart Home Interactive Application Using Stochastic Linear Formal GrammarIEEE Transactions on Instrumentation and Measurement, 2014
- Hand Gesture Recognition in Real Time for Automotive Interfaces: A Multimodal Vision-Based Approach and EvaluationsIEEE Transactions on Intelligent Transportation Systems, 2014
- The flip-chip bump interconnection for millimeter-wave GaAs MMICIEEE Transactions on Electronics Packaging Manufacturing, 1999
- A GTD-based parametric model for radar scatteringIEEE Transactions on Antennas and Propagation, 1995
- A CFAR adaptive matched filter detectorIEEE Transactions on Aerospace and Electronic Systems, 1992
- Optimization of Diode Structures for Monolithic Integrated Microwave CircuitsIEEE Transactions on Microwave Theory and Techniques, 1968
- Geometrical Theory of Diffraction*Journal of the Optical Society of America, 1962