SemNet: Learning semantic attributes for human activity recognition with deep belief networks
Open Access
- 30 August 2022
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Big Data
- Vol. 5, 879389
Abstract
Human Activity Recognition (HAR) is a prominent application in mobile computing and Internet of Things (IoT) that aims to detect human activities based on multimodal sensor signals generated as a result of diverse body movements. Human physical activities are typically composed of simple actions (such as “arm up”, “arm down”, “arm curl”, etc.), referred to assemanticfeatures. Such abstract semantic features, in contrast to high-level activities (“walking”, “sitting”, etc.) and low-level signals (raw sensor readings), can be developed manually to assist activity recognition. Although effective, this manual approach relies heavily on human domain expertise and is not scalable. In this paper, we address this limitation by proposing a machine learning method, SemNet, based on deep belief networks. SemNet automatically constructs semantic features representative of the axial bodily movements. Experimental results show that SemNet outperforms baseline approaches and is capable of learning features that highly correlate with manually defined semantic attributes. Furthermore, our experiments using a different model, namely deep convolutional LSTM, on household activities illustrate the broader applicability of semantic attribute interpretation to diverse deep neural network approaches. These empirical results not only demonstrate that such a deep learning technique is semantically meaningful and superior to its handcrafted counterpart, but also provides a better understanding of the deep learning methods that are used for Human Activity Recognition.Keywords
This publication has 25 references indexed in Scilit:
- FootprintIDProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2017
- Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity RecognitionSensors, 2016
- Using unlabeled data in a sparse-coding framework for human activity recognitionPervasive and Mobile Computing, 2014
- The Opportunity challenge: A benchmark database for on-body sensor-based activity recognitionPattern Recognition Letters, 2013
- Learning with Hierarchical-Deep ModelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- MobiSens: A Versatile Mobile Sensing Platform for Real-World ApplicationsMobile Networks and Applications, 2012
- Mobile Lifelogger – Recording, Indexing, and Understanding a Mobile User’s Life2012
- Large-Scale Learning of Structure−Activity Relationships Using a Linear Support Vector Machine and Problem-Specific MetricsJournal of Chemical Information and Modeling, 2011
- Activity Recognition from User-Annotated Acceleration Data2004
- Training Products of Experts by Minimizing Contrastive DivergenceNeural Computation, 2002