Robust skeletal motion tracking using temporal and spatial synchronization of two video streams
Open Access
- 7 August 2025
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 20 (8) , e0328969
Abstract
Accurate and reliable skeletal motion tracking is essential for rehabilitation monitoring, enabling objective assessment of patient progress and facilitating telerehabilitation applications. Traditional marker-based motion capture systems, while highly accurate, are costly and impractical for home rehabilitation, whereas marker-less methods often suffer from depth estimation errors and occlusions. Recent studies have explored various computer vision and deep learning approaches for human pose estimation, yet challenges remain in ensuring robust depth accuracy and tracking under occlusion conditions. This study proposes a three-dimensional human skeleton tracking system for upper limb activities that integrates temporal and spatial synchronization to improve depth estimation accuracy for rehabilitation exercises. The proposed system combines a 90° secondary camera to compensate for the depth prediction inaccuracies inherent in single-camera systems, reducing error margins by up to 0.4 m. In addition, a linear regression-based depth error correction model is implemented to refine depth coordinates, further improving tracking precision. The Kalman filtering framework is employed to enhance temporal consistency, allowing real-time interpolation of missing joint positions. Experimental results demonstrate that the proposed method significantly reduces depth estimation errors of the elbow and wrist joint (p < 0.001) compared to single camera setups, particularly in scenarios involving occlusions and non-frontal perspectives. This study provides a cost-effective and scalable solution for remote patient monitoring and motor function evaluation.Keywords
Funding Information
- Lietuvos Mokslo Taryba (S-PD-24-29)
This publication has 47 references indexed in Scilit:
- Deep learning-based human body pose estimation in providing feedback for physical movement: A reviewHeliyon, 2024
- Clinical gait analysis using video-based pose estimation: Multiple perspectives, clinical populations, and measuring changePLOS Digital Health, 2024
- Monocular Depth Estimation: A Thorough ReviewIEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
- Deep Learning for Human Activity Recognition on 3D Human Skeleton: Survey and Comparative StudySensors, 2023
- Opportunities for Improving Motor Assessment and Rehabilitation After Stroke by Leveraging Video-Based Pose EstimationAmerican Journal of Physical Medicine & Rehabilitation, 2023
- From raw measurements to human pose - a dataset with low-cost and high-end inertial-magnetic sensor dataScientific Data, 2022
- Top-Down System for Multi-Person 3D Absolute Pose Estimation from Monocular VideosSensors, 2022
- The Potential of Computer Vision-Based Marker-Less Human Motion Analysis for RehabilitationRehabilitation Process and Outcome, 2021
- A review of computational approaches for evaluation of rehabilitation exercisesComputers in Biology and Medicine, 2020
- A Precision Analysis of Camera Distortion ModelsIEEE Transactions on Image Processing, 2017