Action Recognition Algorithm of Spatio–Temporal Differential LSTM Based on Feature Enhancement
Open Access
- 26 August 2021
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 11 (17) , 7876
Abstract
The Long Short-Term Memory (LSTM) network is a classic action recognition method because of its ability to extract time information. Researchers proposed many hybrid algorithms based on LSTM for human action recognition. In this paper, an improved Spatio–Temporal Differential Long Short-Term Memory (ST-D LSTM) network is proposed, an enhanced input differential feature module and a spatial memory state differential module are added to the network. Furthermore, a transmission mode of ST-D LSTM is proposed; this mode enables ST-D LSTM units to transmit the spatial memory state horizontally. Finally, these improvements are added into classical Long-term Recurrent Convolutional Networks (LRCN) to test the new network’s performance. Experimental results show that ST-D LSTM can effectively improve the accuracy of LRCN.Keywords
This publication has 18 references indexed in Scilit:
- DB-LSTM: Densely-connected Bi-directional LSTM for human action recognitionNeurocomputing, 2021
- MFANet: A Multi-Level Feature Aggregation Network for Semantic Segmentation of Land CoverRemote Sensing, 2021
- Cloud/shadow segmentation based on global attention feature fusion residual network for remote sensing imageryInternational Journal of Remote Sensing, 2020
- Multi-Stage Feature Constraints Learning for Age EstimationIEEE Transactions on Information Forensics and Security, 2020
- RPAN: An End-to-End Recurrent Pose-Attention Network for Action Recognition in Videos2017
- Spatio-Temporal VLAD Encoding for Human Action Recognition in Videos2016
- Bag of visual words and fusion methods for action recognition: Comprehensive study and good practiceComputer Vision and Image Understanding, 2016
- Action Recognition with Improved Trajectories2013
- All About VLAD2013
- Dense Trajectories and Motion Boundary Descriptors for Action RecognitionInternational Journal of Computer Vision, 2013