Deep Heterogeneous Contrastive Hyper-Graph Learning for In-the-Wild Context-Aware Human Activity Recognition
Open Access
- 19 December 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 7 (4) , 1-23
Abstract
Human Activity Recognition (HAR) is a challenging, multi-label classification problem as activities may co-occur and sensor signals corresponding to the same activity may vary in different contexts (e.g., different device placements). This paper proposes a Deep Heterogeneous Contrastive Hyper-Graph Learning (DHC-HGL) framework that captures heterogenous Context-Aware HAR (CA-HAR) hypergraph properties in a message-passing and neighborhood-aggregation fashion. Prior work only explored homogeneous or shallow-node-heterogeneous graphs. DHC-HGL handles heterogeneous CA-HAR data by innovatively 1) Constructing three different types of sub-hypergraphs that are each passed through different custom HyperGraph Convolution (HGC) layers designed to handle edge-heterogeneity and 2) Adopting a contrastive loss function to ensure node-heterogeneity. In rigorous evaluation on two CA-HAR datasets, DHC-HGL significantly outperformed state-of-the-art baselines by 5.8% to 16.7% on Matthews Correlation Coefficient (MCC) and 3.0% to 8.4% on Macro F1 scores. UMAP visualizations of learned CA-HAR node embeddings are also presented to enhance model explainability. Our code is publicly available1 to encourage further research.Keywords
All Related Versions
Funding Information
- Defense Advanced Research Projects Agency (HR00111780032-WASH-FP-031)
This publication has 35 references indexed in Scilit:
- A Human Activity Recognition Algorithm Based on Stacking Denoising Autoencoder and LightGBMSensors, 2019
- Heterogeneous Information Network Embedding for RecommendationIEEE Transactions on Knowledge and Data Engineering, 2018
- RDeepSenseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2018
- Recognizing Detailed Human Context in the Wild from Smartphones and SmartwatchesIEEE Pervasive Computing, 2017
- Evaluating the specifications of built-in accelerometers in smartphones on fall detection performanceInstrumentation Science & Technology, 2017
- A survey of energy-efficient context recognition systems using wearable sensors for healthcare applicationsPervasive and Mobile Computing, 2017
- Heterogeneous hypergraph embedding for document recommendationNeurocomputing, 2016
- Smartphone-based monitoring system for activities of daily living for elderly people and their relatives etc.2013
- K-nearest neighborScholarpedia, 2009
- Dimensionality Reduction by Learning an Invariant Mapping2006