Detection and Validation of Macro-Activities in Human Inertial Signals Using Graph Link Prediction
Open Access
Abstract
With the continuous development of new wearable devices, sensor-based human activity recognition is enjoying enormous popularity in research and industry. The signals from inertial sensors allow for the detection, classification, and analysis of human activities such as jogging, cycling, or swimming. However, human activity recognition is often limited to basic activities that occur in short, predetermined periods of time (sliding windows). Complex macro-activities, such as multi-step sports exercises or multi-step cooking recipes, are still only considered to a limited extent, while some works have investigated the classification of macro-activities, the automated understanding of how the underlying micro-activities interact remains an open challenge. This study addresses this gap through the application of graph link prediction, a well-known concept in graph theory and graph neural networks (GNNs). To this end, the presented approach transforms micro-activity sequences into micro-activity graphs that are then processed with a GNN. The evaluation on two derived real-world data sets shows that graph link prediction enables the accurate identification of interactions between micro-activities and the precise validation of composite macro-activities based on learned graph embeddings. Furthermore, this work shows that GNNs can benefit from positional encodings in sequence recognition tasks.Keywords
Funding Information
- Bosch Sensortec GmbH
This publication has 27 references indexed in Scilit:
- An enhanced recommender system based on heterogeneous graph link predictionEngineering Applications of Artificial Intelligence, 2023
- Domain-Knowledge Enhanced Machine Learning for Table Tennis Stroke Characterization2023
- TinyGraphHAR: Enhancing Human Activity Recognition With Graph Neural Networks2023
- A multi-scale feature extraction fusion model for human activity recognitionScientific Reports, 2022
- KU-HAR: An open dataset for heterogeneous human activity recognitionPattern Recognition Letters, 2021
- Summary of the Cooking Activity Recognition Challenge2020
- Volleyball Skill Assessment Using a Single Wearable Micro Inertial Measurement Unit at WristIEEE Access, 2018
- Adaptive sliding window segmentation for physical activity recognition using a single tri-axial accelerometerPervasive and Mobile Computing, 2017
- Dynamic detection of window starting positions and its implementation within an activity recognition frameworkJournal of Biomedical Informatics, 2016
- Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine2012