Markerless Motion Capture and Measurement of Hand Kinematics: Validation and Application to Home-Based Upper Limb Rehabilitation
Authors:
- 1 August 2013
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 60 (8) , 2184-2192
Abstract
Dynamic movements of the hand, fingers, and thumb are difficult to measure due to the versatility and complexity of movement inherent in function. An innovative approach to measuring hand kinematics is proposed and validated. The proposed system utilizes the Microsoft Kinect and goes beyond gesture recognition to develop a validated measurement technique of finger kinematics. The proposed system adopted landmark definition (validated through ground truth estimation against assessors) and grip classification algorithms, including kinematic definitions (validated against a laboratory-based motion capture system). The results of the validation show 78% accuracy when identifying specific markerless landmarks. In addition, comparative data with a previously validated kinematic measurement technique show accuracy of MCP ± 10° (average absolute error (AAE) = 2.4°), PIP ± 12° (AAE = 4.8°), and DIP ± 11° (AAE = 4.8°). These results are notably better than clinically based alternative manual measurement techniques. The ability to measure hand movements, and therefore functional dexterity, without interfering with underlying composite movements, is the paramount objective to any bespoke measurement system. The proposed system is the first validated markerless measurement system using the Microsoft Kinect that is capable of measuring finger joint kinematics. It is suitable for home-based motion capture for the hand and, therefore, achieves this objective.Keywords
This publication has 32 references indexed in Scilit:
- Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplaceApplied Ergonomics, 2012
- A comparison of Coulomb and pseudo-Coulomb friction implementations: Application to the table contact phase of gymnastics vaultingJournal of Biomechanics, 2011
- Automated Markerless Analysis of Human Gait Motion for Recognition and ClassificationETRI Journal, 2011
- Non-invasive determination of coupled motion of the scapula and humerus—An in-vitro validationJournal of Biomechanics, 2011
- Validity and test-retest reliability of manual goniometers for measuring passive hip range of motion in femoroacetabular impingement patients.BMC Musculoskeletal Disorders, 2010
- Accuracy and Reliability of Three Different Techniques for Manual Goniometry for Wrist Motion: A Cadaveric StudyThe Journal of Hand Surgery, 2009
- HandPuppet3D: Motion capture and analysis for character animationArtificial Intelligence Review, 2009
- A Markerless Motion Capture System to Study Musculoskeletal Biomechanics: Visual Hull and Simulated Annealing ApproachAnnals of Biomedical Engineering, 2006
- In vivo measurement of 3-D skeletal kinematics from sequences of biplane radiographs: Application to knee kinematicsIEEE Transactions on Medical Imaging, 2001
- Model-based analysis of hand postureIEEE Computer Graphics and Applications, 1995