Human Action Recognition for Dynamic Scenes of Emergency Rescue Based on Spatial-Temporal Fusion Network
Open Access
- 20 January 2023
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 12 (3) , 538
Abstract
Targeting the problems of the insufficient utilization of temporal and spatial information in videos and a lower accuracy rate, this paper proposes a human action recognition method for dynamic videos of emergency rescue based on a spatial-temporal fusion network. A time domain segmentation strategy based on random sampling maintains the overall time domain structure of the video. Considering the spatial-temporal asynchronous relationship, multiple asynchronous motion sequences are increased as input of the temporal convolutional network. spatial-temporal features are fused in convolutional layers to reduce feature loss. Because time series information is crucial for human action recognition, the acquired mid-layer spatial-temporal fusion features are sent into Bidirectional Long Short-Term Memory (Bi-LSTM) to obtain the human movement features in the whole video temporal dimension. Experiment results show the proposed method fully fuses spatial and temporal dimension information and improves the accuracy of human action recognition in dynamic scenes. It is also faster than traditional methods.Keywords
Funding Information
- National Key Research and Development Program project (2020YFC0811004, 61371143, KM202110009002)
- National Natural Science Fund of China (2020YFC0811004, 61371143, KM202110009002)
- R&D Program of Beijing Municipal Education Commission (2020YFC0811004, 61371143, KM202110009002)
This publication has 19 references indexed in Scilit:
- A Flexible High-Level Fusion for an Accurate Human Action Recognition SystemJournal of Circuits, Systems and Computers, 2020
- Spatiotemporal information deep fusion network with frame attention mechanism for video action recognitionJournal of Electronic Imaging, 2019
- Learning Spatio-Temporal Representation with Pseudo-3D Residual Networks2017
- Two-Stream 3-D convNet Fusion for Action Recognition in Videos With Arbitrary Size and LengthIEEE Transactions on Multimedia, 2017
- Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset2017
- Temporal Segment Networks: Towards Good Practices for Deep Action Recognition2016
- Convolutional Two-Stream Network Fusion for Video Action Recognition2016
- Learning Spatiotemporal Features with 3D Convolutional Networks2015
- 3D Convolutional Neural Networks for Human Action RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Recognizing human actions: a local SVM approach2004