A Real-Time Deployable Attention-Driven CNN–LSTM Framework for Human Activity Recognition Using Wearable Sensor
- 22 September 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (21) , 40461-40471
Abstract
Human Activity Recognition (HAR) using wearable inertial sensors is increasingly vital for healthcare, rehabilitation, and pervasive computing. Yet, many state-of-the-art models rely on handcrafted feature engineering, heavy time–frequency transformations, or large neural networks, limiting real-time deployment on resource-constrained smartphones and wearables. We propose an end-to-end, lightweight attention-guided CNN–CBAM–LSTM architecture that directly consumes raw IMU signals standardized by StandardScaler, eliminating costly preprocessing. Our design uniquely combines: (i) multi-resolution convolutional kernels to capture diverse motion dynamics; (ii) Convolutional Block Attention Modules (CBAM) to adaptively highlight salient spatial features and suppress sensor noise; and (iii) temporal self-attention atop stacked LSTM layers to model long-range temporal dependencies. Extensive experiments on three public HAR benchmarks—mHealth (controlled), MotionSense (uncontrolled), and UCI HAR (semi-controlled)—show that our model achieves accuracies of 99.7%, 99.5%, and 99.4% respectively, consistently surpassing recent baselines. Moreover, structured pruning and quantization compress the model to just 130.8 KB, while real-world tests on a Snapdragon 845-class Android device confirm ultra-low inference latency of 13.5 ms per segment under live streaming. This fusion of high accuracy, low latency, and minimal memory footprint demonstrates the potential of attention-driven, multi-resolution deep learning for practical, real-time edge AI in HAR applications.Keywords
This publication has 27 references indexed in Scilit:
- Quantum contrastive learning for human activity recognitionSmart Health, 2025
- A sparse diverse-branch large kernel convolutional neural network for human activity recognition using wearablesApplied Soft Computing, 2024
- MFCANN: A feature diversification framework based on local and global attention for human activity recognitionEngineering Applications of Artificial Intelligence, 2024
- Multiple inputs modeling of hybrid convolutional neural networks for human activity recognitionBiomedical Signal Processing and Control, 2024
- An efficient 3D convolutional neural network with informative 3D volumes for human activity recognition using wearable sensorsMultimedia Tools and Applications, 2023
- Temporal-channel convolution with self-attention network for human activity recognition using wearable sensorsKnowledge-Based Systems, 2023
- DanHAR: Dual Attention Network for multimodal human activity recognition using wearable sensorsApplied Soft Computing, 2021
- Human activity recognition using deep transfer learning of cross position sensor based on vertical distribution of dataMultimedia Tools and Applications, 2021
- An optimized hybrid deep learning model using ensemble learning approach for human walking activities recognitionThe Journal of Supercomputing, 2021
- mHealthDroid: A Novel Framework for Agile Development of Mobile Health Applications2014