Pathological-Gait Recognition Using Spatiotemporal Graph Convolutional Networks and Attention Model
Open Access
Abstract
Walking is an exercise that uses muscles and joints of the human body and is essential for understanding body condition. Analyzing body movements through gait has been studied and applied in human identification, sports science, and medicine. This study investigated a spatiotemporal graph convolutional network model (ST-GCN), using attention techniques applied to pathological-gait classification from the collected skeletal information. The focus of this study was twofold. The first objective was extracting spatiotemporal features from skeletal information presented by joint connections and applying these features to graph convolutional neural networks. The second objective was developing an attention mechanism for spatiotemporal graph convolutional neural networks, to focus on important joints in the current gait. This model establishes a pathological-gait-classification system for diagnosing sarcopenia. Experiments on three datasets, namely NTU RGB+D, pathological gait of GIST, and multimodal-gait symmetry (MMGS), validate that the proposed model outperforms existing models in gait classification.Keywords
Funding Information
- National Research Foundation of Korea (2021R1A1A03040177)
This publication has 45 references indexed in Scilit:
- A Review on Accelerometry-Based Gait Analysis and Emerging Clinical ApplicationsIEEE Reviews in Biomedical Engineering, 2018
- Deformable Convolutional Networks2017
- Contactless and Hassle Free Real Time Heart Rate Measurement with Facial VideoJournal of Cardiac Critical Care TSS, 2017
- Multi-context Attention for Human Pose Estimation2017
- Residual Attention Network for Image Classification2017
- Neural Aggregation Network for Video Face Recognition2017
- NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis2016
- Learning Deep Features for Discriminative Localization2016
- Gait Analysis Methods: An Overview of Wearable and Non-Wearable Systems, Highlighting Clinical ApplicationsSensors, 2014
- The Graph Neural Network ModelIEEE Transactions on Neural Networks, 2008