Gesture Recognition Using MIMO Radar Point Clouds With Targeted Signal Processing for Resource-Limited Platforms
Open Access
- 22 October 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (18) , 35335-35354
Abstract
Utilizing gestures for human-machine interaction offers numerous benefits for both products and users. Hand Gesture Recognition (HGR) systems, particularly those using radar sensors, are gaining attention due to their potential for real-time applications. However, mainstream methods often rely on unrefined 2D or 3D radar signals, which are typically large and redundant, requiring the use of large neural network classifiers. This high computational demand limits their deployment on low-cost, resource-constrained edge platforms. In this paper, we propose a low-cost, close-range HGR system based on a 24 GHz Frequency Modulated Continuous Wave (FMCW) Multi-Input Multi-Output (MIMO) radar designed for resource-constrained environments. By applying beamforming, Constant False Alarm Rate (CFAR) target detection, and feature extraction, our experiments show that targeted signal processing on dimensions like range, velocity, and angle can effectively classify gestures. This approach achieves a recognition accuracy of 99.60% for four gesture types using a lightweight Conventional Neural Network (CNN). By focusing on efficient radar signal processing rather than complex neural networks, we successfully deployed the system on an embedded platform. The system achieved accuracy rates of 99.36%, 95.00%, and 95.64% for a well-trained user and two non-trained users, respectively.Keywords
Funding Information
- Key Research and Development Program of Shaanxi Province (2020ZDXM5-01)
This publication has 42 references indexed in Scilit:
- Computer vision-based hand gesture recognition for human-robot interaction: a reviewComplex & Intelligent Systems, 2023
- Exploring hand gesture recognition using micro-Doppler radar data based on vision transformersJournal of Physics: Conference Series, 2023
- Input modality matters: A comparison of touch, speech, and gesture based in-vehicle interactionApplied Ergonomics, 2022
- Literature review of vision‐based dynamic gesture recognition using deep learning techniquesConcurrency and Computation: Practice and Experience, 2022
- HyFiNet: Hybrid feature attention network for hand gesture recognitionMultimedia Tools and Applications, 2022
- Vision-based Hand Gesture Recognition for Indian Sign Language Using Convolution Neural NetworkIETE Journal of Research, 2020
- Development and Demonstration of MIMO-SAR mmWave Imaging TestbedsIEEE Access, 2020
- Hand Gesture Recognition for Human Computer Interaction and Its Applications in Virtual Reality2019
- Optimum Array Processing2002
- Analysis of some modified ordered statistic CFAR: OSGO and OSSO CFARIEEE Transactions on Aerospace and Electronic Systems, 1990