Proposal for Post Hoc Quality Control in Instrumented Motion Analysis Using Markerless Motion Capture: Development and Usability Study
Authors:
- Hanna Marie RöhlingHRHanna Marie Röhling
- Patrik AlthoffPAPatrik Althoff
- Radina ArsenovaRARadina Arsenova
- Daniel DrebingerDDDaniel Drebinger
- Norman GigengackNGNorman Gigengack
- Anna ChorschewACAnna Chorschew
- Daniel KronebergDKDaniel Kroneberg
- Maria RönnefarthMRMaria Rönnefarth
- Tobias EllermeyerTETobias Ellermeyer
- Sina Cathérine RosenkranzSRSina Cathérine Rosenkranz
- Christoph HeesenCHChristoph Heesen
- Behnoush BehniaBBBehnoush Behnia
Open Access
- 1 April 2022
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 9 (2) , e26825
Abstract
Background: Instrumented assessment of motor symptoms has emerged as a promising extension to the clinical assessment of several movement disorders. The use of mobile and inexpensive technologies such as some markerless motion capture technologies is especially promising for large-scale application but has not transitioned into clinical routine to date. A crucial step on this path is to implement standardized, clinically applicable tools that identify and control for quality concerns. Objective: The main goal of this study comprises the development of a systematic quality control (QC) procedure for data collected with markerless motion capture technology and its experimental implementation to identify specific quality concerns and thereby rate the usability of recordings. Methods: We developed a post hoc QC pipeline that was evaluated using a large set of short motor task recordings of healthy controls (2010 recordings from 162 subjects) and people with multiple sclerosis (2682 recordings from 187 subjects). For each of these recordings, 2 raters independently applied the pipeline. They provided overall usability decisions and identified technical and performance-related quality concerns, which yielded respective proportions of their occurrence as a main result. Results: The approach developed here has proven user-friendly and applicable on a large scale. Raters’ decisions on recording usability were concordant in 71.5%-92.3% of cases, depending on the motor task. Furthermore, 39.6%-85.1% of recordings were concordantly rated as being of satisfactory quality whereas in 5.0%-26.3%, both raters agreed to discard the recording. Conclusions: We present a QC pipeline that seems feasible and useful for instant quality screening in the clinical setting. Results confirm the need of QC despite using standard test setups, testing protocols, and operator training for the employed system and by extension, for other task-based motor assessment technologies. Results of the QC process can be used to clean existing data sets, optimize quality assurance measures, as well as foster the development of automated QC approaches and therefore improve the overall reliability of kinematic data sets.Keywords
All Related Versions
This publication has 42 references indexed in Scilit:
- Inertial Sensor-Based Stride Parameter Calculation From Gait Sequences in Geriatric PatientsIEEE Transactions on Biomedical Engineering, 2014
- Using perceptive computing in multiple sclerosis - the Short Maximum Speed Walk testJournal of NeuroEngineering and Rehabilitation, 2014
- Inter- and intra-rater reliability of the GAITRite system among individuals with sub-acute strokeGait & Posture, 2014
- Gait Analysis Methods: An Overview of Wearable and Non-Wearable Systems, Highlighting Clinical ApplicationsSensors, 2014
- The OSCAR-IB Consensus Criteria for Retinal OCT Quality AssessmentPLOS ONE, 2012
- ISway: a sensitive, valid and reliable measure of postural controlJournal of NeuroEngineering and Rehabilitation, 2012
- A normative sample of temporal and spatial gait parameters in children using the GAITRite® electronic walkwayGait & Posture, 2007
- Guidelines for clinical applications of spatio-temporal gait analysis in older adultsAging Clinical and Experimental Research, 2006
- Validity of the GAITRite® walkway system for the measurement of averaged and individual step parameters of gaitGait & Posture, 2005
- Rating neurologic impairment in multiple sclerosisNeurology, 1983