Encoded Marker Clusters for Auto-Labeling in Optical Motion Capture
Open Access
- 22 February 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 44 (2) , 1-16
Abstract
Marker-based optical motion capture (MoCap) is a vital tool in applications such as virtual production, and movement sciences. However, reconstructing scattered MoCap data into real motion sequences is challenging, and data processing is time-consuming and labor-intensive. Here we propose a novel framework for MoCap auto-labeling and matching. In this framework, we designed novel clusters of reflective markers called auto-labeling encoded marker clusters (AEMCs), including clusters with an explicit header (AEMCs-E) and an implicit header (AEMCs-I). Combining cluster design and coding theory gives each cluster a unique codeword for MoCap auto-labeling and matching. Moreover, we provide a method of mapping and decoding for cluster labeling. The labeling results are only determined by the intrinsic characteristics of the clusters instead of the skeleton structure or posture of the subjects. Compared with commercial software and data-driven methods, our method has better labeling accuracy in heterogeneous targets and unknown marker layouts, which demonstrates the promising application of motion capture in humans, rigid or flexible robots.Keywords
Funding Information
- National Science Foundation of China (62103035)
- Beijing Natural Science Foundation (L231004)
- Young Elite Scientists Sponsorship Program by CAST (2022QNRC001)
- Beijing Natural Science Foundation (3222016)
This publication has 25 references indexed in Scilit:
- Development and Validation of a Deep Learning Algorithm and Open-Source Platform for the Automatic Labelling of Motion Capture MarkersIEEE Access, 2021
- Graph Matching for Marker Labeling and Missing Marker Reconstruction With Bone Constraint by LSTM in Optical Motion CaptureIEEE Access, 2021
- Motion tracking in developmental research: Methods, considerations, and applications2020
- Auto-labelling of Markers in Optical Motion Capture by Permutation Learning2019
- Deep Representation Learning for Human Motion Prediction and Classification2017
- Toward accurate real-time marker labeling for live optical motion captureThe Visual Computer, 2017
- A Survey on Human Performance Capture and AnimationJournal of Computer Science and Technology, 2017
- Real-time marker prediction and CoR estimation in optical motion captureThe Visual Computer, 2012
- Autolabeling 3D tracks using neural networksClinical Biomechanics, 2005
- A procedure for automatically estimating model parameters in optical motion captureImage and Vision Computing, 2004