Human Interaction Behavior Recognition based on Local Spatial - Temporal and Global Feature
Authors:
Open Access
- 1 February 2021
- conference paper
- Published by IOP Publishing in Journal of Physics: Conference Series
- Vol. 1754 (1) , 012188
Abstract
At present, the human interaction behavior algorithm has received great attention, but how to effectively extract the interactive characteristics of human interaction and establish the complex model between multiple targets is still a difficult problem. Aiming at this problem, we proposed a human interaction recognition method based on local spatial - temporal and global feature. This method treats people who are interacting as a whole. Firstly, foreground human object is extracted by the inter-frame difference. Secondly, the optical flow and space-time points of interest are extracted. Considering the large and high dimension of the feature, the characteristics of each frame image are described by the gradient direction histogram HOG and the optical flow histogram HOF. Then, BP neural network is used to classify each feature of each frame. Considering the limitations of different features for interactive behavior recognition, BP neural network combined with classification fusion is used to obtain the final interaction behavior category. The algorithm tested in the UT interaction dataset, and the experimental results show that this method can recognize the interaction behaviors of hitting, hugging, kicking, pushing and handshaking. The proposed method can be applied to intelligent video surveillance.Keywords
This publication has 7 references indexed in Scilit:
- Study on Network Security Based on PCA and BP Neural Network Under Green CommunicationIEEE Access, 2020
- An Image Orientation Estimation Method Based on Gradient Histogram and Point Matching2019
- Human Behavior Recognition Algorithm Based on HOG Feature and SVM Classifier2019
- Robust Spatio-Temporal Features for Human Interaction Recognition Via Artificial Neural Network2018
- Fuzzy Histogram of Optical Flow Orientations for Micro-Expression RecognitionIEEE Transactions on Affective Computing, 2017
- Sparse coding-based space-time video representation for action recognitionMultimedia Tools and Applications, 2016
- Supervised framework for automatic recognition and retrieval of interaction: a framework for classification and retrieving videos with similar human interactionsIET Computer Vision, 2016