Human activity recognition from sensor data using spatial attention-aided CNN with genetic algorithm
- 26 October 2022
- journal article
- research article
- Published by Springer Nature in Neural Computing and Applications
- Vol. 35 (7) , 5165-5191
Abstract
Capturing time and frequency relationships of time series signals offers an inherent barrier for automatic human activity recognition (HAR) from wearable sensor data. Extracting spatiotemporal context from the feature space of the sensor reading sequence is challenging for the current recurrent, convolutional, or hybrid activity recognition models. The overall classification accuracy also gets affected by large size feature maps that these models generate. To this end, in this work, we have put forth a hybrid architecture for wearable sensor data-based HAR. We initially use Continuous Wavelet Transform to encode the time series of sensor data as multi-channel images. Then, we utilize a Spatial Attention-aided Convolutional Neural Network (CNN) to extract higher-dimensional features. To find the most essential features for recognizing human activities, we develop a novel feature selection (FS) method. In order to identify the fitness of the features for the FS, we first employ three filter-based methods: Mutual Information (MI), Relief-F, and minimum redundancy maximum relevance (mRMR). The best set of features is then chosen by removing the lower-ranked features using a modified version of the Genetic Algorithm (GA). The K-Nearest Neighbors (KNN) classifier is then used to categorize human activities. We conduct comprehensive experiments on five well-known, publicly accessible HAR datasets, namely UCI-HAR, WISDM, MHEALTH, PAMAP2, and HHAR. Our model significantly outperforms the state-of-the-art models in terms of classification performance. We also observe an improvement in overall recognition accuracy with the use of GA-based FS technique with a lower number of features. The source code of the paper is publicly available here.Keywords
This publication has 116 references indexed in Scilit:
- Transition-Aware Human Activity Recognition Using SmartphonesNeurocomputing, 2016
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Dynamic behavior of suture-anastomosed arteries and implications to vascular surgery operationsBioMedical Engineering OnLine, 2015
- mHealthDroid: A Novel Framework for Agile Development of Mobile Health Applications2014
- Activity recognition using cell phone accelerometersACM SIGKDD Explorations Newsletter, 2011
- Filter versus wrapper gene selection approaches in DNA microarray domainsArtificial Intelligence in Medicine, 2004
- Robust image segmentation using genetic algorithm with a fuzzy measurePattern Recognition, 1996
- Mountain SicknessScientific American, 1992
- Genetic AlgorithmsScientific American, 1992
- A Practical Approach to Feature Selection1992