Differentiable Biomechanics for Markerless Motion Capture in Upper Limb Stroke Rehabilitation: A Comparison with Optical Motion Capture
Preprint
Abstract
Marker-based Optical Motion Capture (OMC) paired with biomechanical modeling is currently considered the most precise and accurate method for measuring human movement kinematics. However, combining differentiable biomechanical modeling with Markerless Motion Capture (MMC) offers a promising approach to motion capture in clinical settings, requiring only minimal equipment, such as synchronized webcams, and minimal effort for data collection. This study compares key kinematic outcomes from biomechanically modeled MMC and OMC data in 15 stroke patients performing the drinking task, a functional task recommended for assessing upper limb movement quality. We observed a high level of agreement in kinematic trajectories between MMC and OMC, as indicated by high correlations (median r above 0.95 for the majority of kinematic trajectories) and median RMSE values ranging from 2-5 degrees for joint angles, 0.04 m/s for end-effector velocity, and 6 mm for trunk displacement. Trial-to-trial biases between OMC and MMC were consistent within participant sessions, with interquartile ranges of bias around 1-3 degrees for joint angles, 0.01 m/s in end-effector velocity, and approximately 3mm for trunk displacement. Our findings indicate that our MMC for arm tracking is approaching the accuracy of marker-based methods, supporting its potential for use in clinical settings. MMC could provide valuable insights into movement rehabilitation in stroke patients, potentially enhancing the effectiveness of rehabilitation strategies.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Differentiable Biomechanics Unlocks Opportunities for Markerless Motion CaptureIEEE International Conference on Rehabilitation Robotics (ICORR), 2025
- Computer vision for kinematic metrics of the drinking task in a pilot study of neurotypical participantsScientific Reports, 2024
- Biomechanical Arm and Hand Tracking with Multiview Markerless Motion Capture2024
- Validation of upper extremity kinematics using Markerless motion captureBiomedical Engineering Advances, 2024
- Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formats2023
- PosePipe: Open-Source Human Pose Estimation Pipeline for Rehabilitation ResearchArchives of Physical Medicine and Rehabilitation, 2022
- Inter-session repeatability of markerless motion capture gait kinematicsJournal of Biomechanics, 2021
- Soft tissue artifact causes significant errors in the calculation of joint angles and range of motion at the hipGait & Posture, 2017
- Full-Body Musculoskeletal Model for Muscle-Driven Simulation of Human GaitIEEE Transactions on Biomedical Engineering, 2016
- Muscle contributions to propulsion and support during runningJournal of Biomechanics, 2010