MRCoach: A Real-Time IoT-Enabled Mixed Reality System With Semantic-Aware Transmission for Smart Sports and Personalized Coaching
- 22 September 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 12 (24) , 52466-52473
Abstract
Real-time transmission of large-scale data, high computational demands, and resource limitations on edge devices poses significant challenges for intelligent sports systems. The proliferation of the Internet of Things (IoT) technologies has catalyzed the rise of smart sport, where wearable sensors, cameras, and intelligent algorithms are integrated to revolutionize athletic training. Despite this transformation, access to professional coaching remains constrained by factors such as time, cost, and scalability. A critical limitation of existing remote coaching approaches is their inability to perform effective spatiotemporal analysis, hindering comprehensive evaluation and refinement of athletic performance. This article introduces mixed reality coaching (MRCoach), a mixed reality-based, immersive, and interactive sports coaching system that enables data-driven training without requiring in-person supervision. MRCoach reconstructs 3-D volumetric avatars of both learners and expert athletes, allowing users to visualize and compare their movements side-by-side in a mixed reality environment for intuitive skill refinement. To ensure responsive and efficient feedback, we propose an adaptive semantic transmission strategy that prioritizes sport-relevant joints, thereby reducing latency and bandwidth requirements without sacrificing accuracy. Furthermore, a 3-D sports analysis framework is developed to evaluate motion based on normalized joint positions, velocities, and accelerations. This framework computes real-time similarity scores and delivers actionable guidance to learners. Experimental results across four sports—tennis, soccer, basketball, and baseball—demonstrate MRCoach’s effectiveness in providing personalized, real-time training experiences. Compared with state-of-the-art baselines such as MagicStream, ExPose, and PIXIE, MRCoach achieves significantly lower end-to-end (E2E) latency (79.9 ms) and higher frame rates ( $\geq 56$ frames/s) while maintaining accurate pose tracking and high avatar fidelity.Keywords
Funding Information
- U.S. NSF (2147623)
- U.S. NSF (2147624)
This publication has 27 references indexed in Scilit:
- Unimotion: Unifying 3D Human Motion Synthesis and Understanding2025
- Implementation of virtual reality technology for sports education and training: Systematic literature reviewProcedia Computer Science, 2023
- Collaborative Regression of Expressive Bodies using Moderation2021
- 3D Human Pose Estimation with Spatial and Temporal Transformers2021
- SPinPong - Virtual Reality Table Tennis Skill Acquisition using Visual, Haptic and Temporal CuesIEEE Transactions on Visualization and Computer Graphics, 2021
- Feasibility Study on Virtual Reality Based Basketball Tactic TrainingIEEE Transactions on Visualization and Computer Graphics, 2020
- Monocular Expressive Body Regression Through Body-Driven Attention2020
- ShuttleSpace: Exploring and Analyzing Movement Trajectory in Immersive VisualizationIEEE Transactions on Visualization and Computer Graphics, 2020
- Expressive Body Capture: 3D Hands, Face, and Body From a Single Image2019
- A 3D virtual environment for training soccer refereesComputer Standards & Interfaces, 2019