Enhancing skeleton-based action recognition with hybrid real and gan-generated datasets
Open Access
- 25 December 2024
- journal article
- Published by Private Company Technology Center in Eastern-European Journal of Enterprise Technologies
- Vol. 6 (2 (132)) , 14-22
Abstract
This research addresses the critical challenge of recognizing mutual actions involving multiple individuals, an important task for applications such as video surveillance, human-computer interaction, autonomous systems, and behavioral analysis. Identifying these actions from 3D skeleton motion sequences poses significant challenges due to the necessity of accurately capturing intricate spatial and temporal patterns in diverse, dynamic, and often unpredictable environments. To tackle this, a robust neural network framework was developed that combines Convolutional Neural Networks (CNNs) for efficient spatial feature extraction with Long Short-Term Memory (LSTM) networks to model temporal dependencies over extended sequences. A distinguishing feature of this study is the creation of a hybrid dataset that which combines real-world skeleton motion data with synthetically generated samples, produced using Generative Adversarial Networks (GANs). This dataset enriches variability, enhances generalization, and mitigates data scarcity challenges. Experimental findings across three different network architectures demonstrate that our method significantly enhances recognition accuracy, mainly due to the integration of CNNs and LSTMs alongside the broadened dataset. Our approach successfully identifies complex interactions and ensures consistent performance across different perspectives and environmental conditions. The improved reliability in recognition indicates that this framework can be effectively utilized in practical applications such as security systems, crowd monitoring, and other areas where precise detection of mutual actions is critical, particularly in real-time and dynamic environmentsKeywords
This publication has 21 references indexed in Scilit:
- RETRACTED: Handcrafted localized phase features for human action recognitionImage and Vision Computing, 2022
- An LSTM Approach to Temporal 3D Object Detection in LiDAR Point Clouds2020
- A survey on video-based Human Action Recognition: recent updates, datasets, challenges, and applicationsArtificial Intelligence Review, 2020
- SkeleMotion: A New Representation of Skeleton Joint Sequences based on Motion Information for 3D Action Recognition2019
- Intelligent video surveillance beyond robust background modelingExpert Systems with Applications, 2018
- Kazakh and Russian Languages Identification Using Long Short-Term Memory Recurrent Neural Networks2017
- NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis2016
- ActivityNet: A large-scale video benchmark for human activity understanding2015
- HMDB: A large video database for human motion recognition2011
- BASEBALL BAT ASSAULT INJURIES1993