A Multimodal Fusion Framework for Enhanced Exercise Quantification Integrating RFID and Computer Vision
Open Access
- 1 August 2025
- journal article
- Published by Tsinghua University Press in Tsinghua Science and Technology
Abstract
The burgeoning field of embodied intelligence, which emphasizes the integration of physical presence with cognitive processes, has opened new avenues for advancing Human-Computer Interactions (HCI), particularly in the domain of smart personalized exercise monitoring. Despite the significant potential, current systems often struggle with the intricacies of multi-user environments, where the accuracy and reliability of exercise tracking are significantly challenged by the complexity of human behaviors and interactions. This paper proposes a multimodal fusion frame work for exercise monitoring system intergrating Radio Frequency Identification (RFID) and Computer Vision (CV), which is the first work to enhance personalized interaction perception in multi-user exercise monitoring scenarios. The system’s workflow is designed to encompass data acquisition, perception modeling, and exercise monitoring, ensuring a comprehensive analysis of exercise performance. The system can utilized multimodal data colledted from RFID and camera to identify who is holding which object and performing what activities. Extensive experi ments have been conducted to evaluate the performance of our system. The experimental results illustrate that the matching accuracy can reach 95%, and estimation accuracy can reach 94% on average.Keywords
This publication has 31 references indexed in Scilit:
- Embodied navigationScience China Information Sciences, 2025
- A Systematic Review of Human Activity Recognition Based on Mobile Devices: Overview, Progress and TrendsIEEE Communications Surveys & Tutorials, 2024
- VoiceMap: Autonomous Mapping of Microphone Array for Voice LocalizationIEEE Internet of Things Journal, 2023
- Spin-Antenna: Enhanced 3D Motion Tracking Via Spinning Antenna Based on COTS RFIDIEEE Transactions on Mobile Computing, 2023
- Exercise plasma boosts memory and dampens brain inflammation via clusterinNature, 2021
- Pre-operative exercise therapy triggers anti-inflammatory trained immunity of Kupffer cells through metabolic reprogrammingNature Metabolism, 2021
- OmniTrack: Orientation-Aware RFID Tracking With Centimeter-Level AccuracyIEEE Transactions on Mobile Computing, 2019
- A Platform for Free-Weight Exercise Monitoring with Passive TagsIEEE Transactions on Mobile Computing, 2017
- Recognizing Multiuser Activities Using Wireless Body Sensor NetworksIEEE Transactions on Mobile Computing, 2011
- LANDMARC: Indoor Location Sensing Using Active RFIDWireless Networks, 2004