GaitForeMer: Self-supervised Pre-training of Transformers via Human Motion Forecasting for Few-Shot Gait Impairment Severity Estimation
- 16 September 2022
- book chapter
- Published by Springer Nature
- Vol. 13438, 130-139
Abstract
Parkinson’s disease (PD) is a neurological disorder that has a variety of observable motor-related symptoms such as slow movement, tremor, muscular rigidity, and impaired posture. PD is typically diagnosed by evaluating the severity of motor impairments according to scoring systems such as the Movement Disorder Society Unified Parkinson’s Disease Rating Scale (MDS-UPDRS). Automated severity prediction using video recordings of individuals provides a promising route for non-intrusive monitoring of motor impairments. However, the limited size of PD gait data hinders model ability and clinical potential. Because of this clinical data scarcity and inspired by the recent advances in self-supervised large-scale language models like GPT-3, we use human motion forecasting as an effective self-supervised pre-training task for the estimation of motor impairment severity. We introduce GaitForeMer, Gait Forecasting and impairment estimation transforMer, which is first pre-trained on public datasets to forecast gait movements and then applied to clinical data to predict MDS-UPDRS gait impairment severity. Our method outperforms previous approaches that rely solely on clinical data by a large margin, achieving an F\(_1\) score of 0.76, precision of 0.79, and recall of 0.75. Using GaitForeMer, we show how public human movement data repositories can assist clinical use cases through learning universal motion representations. The code is available at https://github.com/markendo/GaitForeMer. Keywords Few-shot learning Gait analysis Transformer
Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Progressive Gait Deficits in Parkinson’s Disease: A Wearable-Based Biannual 5-Year Prospective StudyFrontiers in Aging Neuroscience, 2019
- Prevalence of Parkinson’s disease across North Americanpj Parkinson's Disease, 2018
- DeepRank2017
- NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis2016
- Compensatory neural mechanisms in cognitively unimpaired Parkinson diseaseAnnals of Neurology, 2016
- Parkinson's Disease and Its Management: Part 1: Disease Entity, Risk Factors, Pathophysiology, Clinical Presentation, and Diagnosis.2015
- Movement Disorder Society‐sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS‐UPDRS): Scale presentation and clinimetric testing resultsMovement Disorders, 2008
- Microglial Imaging in Movement Disorders With PK11195 PETJournal of Movement Disorders, 2008
- Nonmotor symptoms of Parkinson’s diseaseExpert Review of Neurotherapeutics, 2006
- Individual Comparisons by Ranking Methods1992