Validation and application of computer vision algorithms for video-based tremor analysis
Open Access
- 21 June 2024
- journal article
- research article
- Published by Springer Nature in npj Digital Medicine
- Vol. 7 (1) , 1-13
Abstract
Tremor is one of the most common neurological symptoms. Its clinical and neurobiological complexity necessitates novel approaches for granular phenotyping. Instrumented neurophysiological analyses have proven useful, but are highly resource-intensive and lack broad accessibility. In contrast, bedside scores are simple to administer, but lack the granularity to capture subtle but relevant tremor features. We utilise the open-source computer vision pose tracking algorithm Mediapipe to track hands in clinical video recordings and use the resulting time series to compute canonical tremor features. This approach is compared to marker-based 3D motion capture, wrist-worn accelerometry, clinical scoring and a second, specifically trained tremor-specific algorithm in two independent clinical cohorts. These cohorts consisted of 66 patients diagnosed with essential tremor, assessed in different task conditions and states of deep brain stimulation therapy. We find that Mediapipe-derived tremor metrics exhibit high convergent clinical validity to scores (Spearman’s ρ = 0.55–0.86, p≤ .01) as well as an accuracy of up to 2.60 mm (95% CI [−3.13, 8.23]) and ≤0.21 Hz (95% CI [−0.05, 0.46]) for tremor amplitude and frequency measurements, matching gold-standard equipment. Mediapipe, but not the disease-specific algorithm, was capable of analysing videos involving complex configurational changes of the hands. Moreover, it enabled the extraction of tremor features with diagnostic and prognostic relevance, a dimension which conventional tremor scores were unable to provide. Collectively, this demonstrates that current computer vision algorithms can be transformed into an accurate and highly accessible tool for video-based tremor analysis, yielding comparable results to gold standard tremor recordings.Keywords
This publication has 71 references indexed in Scilit:
- How common is the most common adult movement disorder? Update on the worldwide prevalence of essential tremorMovement Disorders, 2010
- Assessment of interrater and intrarater reliability of the Fahn–Tolosa–Marin Tremor Rating Scale in essential tremorMovement Disorders, 2007
- Kinematic analysis of thalamic versus subthalamic neurostimulation in postural and intention tremorBrain, 2007
- Common Misdiagnosis of a Common Neurological DisorderArchives of Neurology, 2006
- Tremor amplitude is logarithmically related to 4- and 5-point tremor rating scalesBrain, 2006
- The pathophysiology of tremorMuscle & Nerve, 2001
- Evaluation of three different ways of assessing tremor in multiple sclerosisJournal of Neurology, Neurosurgery & Psychiatry, 2000
- Side-to-side correlation of muscle activity in physiological and pathological human tremorsClinical Neurophysiology, 1999
- Thalamic Stimulation and Proximal TremorArchives of Neurology, 1993
- Variability in amplitude of untreated essential tremor.Journal of Neurology, Neurosurgery & Psychiatry, 1987