Self-Attention-Based Deep Convolution LSTM Framework for Sensor-Based Badminton Activity Recognition
Open Access
Abstract
Sensor-based human activity recognition aims to classify human activities or behaviors according to the data from wearable or embedded sensors, leading to a new direction in the field of Artificial Intelligence. When the activities become high-level and sophisticated, such as in the multiple technical skills of playing badminton, it is usually a challenging task due to the difficulty of feature extraction from the sensor data. As a kind of end-to-end approach, deep neural networks have the capacity of automatic feature learning and extracting. However, most current studies on sensor-based badminton activity recognition adopt CNN-based architectures, which lack the ability of capturing temporal information and global signal comprehension. To overcome these shortcomings, we propose a deep learning framework which combines the convolutional layers, LSTM structure, and self-attention mechanism together. Specifically, this framework can automatically extract the local features of the sensor signals in time domain, take the LSTM structure for processing the badminton activity data, and focus attention on the information that is essential to the badminton activity recognition task. It is demonstrated by the experimental results on an actual badminton single sensor dataset that our proposed framework has obtained a badminton activity recognition (37 classes) accuracy of , which outperforms the existing methods, and also has the advantages of lower training time and faster convergence.
Keywords
Funding Information
- National Key Research and Development Program of China (2018AAA0100205)
This publication has 23 references indexed in Scilit:
- A novel random forests based class incremental learning method for activity recognitionPattern Recognition, 2018
- Wearable Motion Sensor Based Analysis of Swing Sports2017
- Ensembles of Deep LSTM Learners for Activity Recognition using WearablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2017
- DeepSense2017
- Activity recognition of a badminton game through accelerometer and gyroscope2016
- Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural NetworkIEEE Access, 2016
- Badminton Stroke Recognition Based on Body Sensor NetworksIEEE Transactions on Human-Machine Systems, 2016
- Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity RecognitionSensors, 2016
- A-Wristocracy: Deep learning on wrist-worn sensing for recognition of user complex activities2015
- Preprocessing techniques for context recognition from accelerometer dataPersonal and Ubiquitous Computing, 2010