Hybrid Zone: Bridging Acoustic and Wi-Fi for Enhanced Gesture Recognition
Authors:
- 20 May 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 981-990
Abstract
Gesture recognition has significant applications such as assisted living, e-health, and human-device interactions. Moving away from conventional computer vision techniques, recent studies are turning towards ubiquitous methods such as Wi-Fi and acoustic signals, which offer device deployment at minimal costs. In this paper, we explore these two ubiquitous techniques to enhance gesture recognition, addressing challenges related to multi-modal fusion. Due to the inherent differences in signal types, we employ a tailored method to harmonize information from these distinct signals. Traditional multi-modal fusion methods often lack theoretical models due to insufficient analysis of the foundational characteristics of different signals. In particular, we propose a concept, Hybrid Zone, which is a theoretical model illustrating the fusion of acoustic and Wi-Fi sensing. Hybrid zone offers a comprehensive perspective on the fusion of acoustic and Wi-Fi sensing areas. Moreover, it provides an intricate view of the synthesis of acoustic and Wi-Fi velocities at a granular level. Our experimental results have been promising, achieving a high accuracy rate of 93.75% in gesture recognition.Keywords
This publication has 26 references indexed in Scilit:
- WSTrack: A Wi-Fi and Sound Fusion System for Device-free Human Tracking2023
- RC6D: An RFID and CV Fusion System for Real-time 6D Object Pose Estimation2022
- CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification2021
- WiFi CSI-based device-free sensing: from Fresnel zone model to CSI-ratio modelCCF Transactions on Pervasive Computing and Interaction, 2021
- WiFi-Based Cross-Domain Gesture Recognition via Modified Prototypical NetworksIEEE Internet of Things Journal, 2021
- Widar3.0: Zero-Effort Cross-Domain Gesture Recognition with Wi-FiIEEE Transactions on Pattern Analysis and Machine Intelligence, 2021
- CSI Fingerprinting Localization With Low Human EffortsIEEE/ACM Transactions on Networking, 2021
- Wi-Fi Localization Enabling Self-CalibrationIEEE/ACM Transactions on Networking, 2021
- CCNet: Criss-Cross Attention for Semantic Segmentation2019
- Whole-home gesture recognition using wireless signals2013