Hybrid features-enabled dragon deep belief neural network for activity recognition
Authors:
- 3 July 2018
- journal article
- research article
- Published by Taylor & Francis in The Imaging Science Journal
- Vol. 66 (6) , 355-371
Abstract
Activity recognition is a challenging task in computer vision that finds widespread applications in various fields, such as motion capture, video retrieval, security, and video surveillance. The objective of this work is to present a technique for recognizing human activities in videos using Dragon Deep Belief Network (DDBN) and hybrid features, which comprises of features like shape, coverage factor, and Space-Time Interest (STI) points. Initially, the keyframes from the input video sequence are extracted using Structural Similarity (SSIM) measure. Then, the features, such as shape, coverage factor, and STI points, are extracted from the keyframes. Based on the feature vector extracted, the proposed DDBN classifier, which is designed by the effective combination of DBN and Dragonfly Algorithm (DA), a classification on human activities, such as walk, bend, etc. in videos. In DDBN, the weights in the network are selected optimally using DA. The weight update using the DA for each incoming feature improves the performance of the DDBN classifier. Further it improves the accuracy in classification of actions. The proposed DDBN classifier is experimented using KTH and Weizmann datasets based on three evaluation parameters, such as accuracy, sensitivity, and specificity. From the performance evaluation, the proposed DDBN classifier could attain better performance with the probability of 98.5% accuracy, 0.96 sensitivity, and 0.959 specificity, respectively.Keywords
This publication has 23 references indexed in Scilit:
- Semantic human activity recognition: A literature reviewPattern Recognition, 2015
- Anatomical-plane-based representation for human–human interactions analysisPattern Recognition, 2015
- A Robust and Efficient Video Representation for Action RecognitionInternational Journal of Computer Vision, 2015
- Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problemsNeural Computing and Applications, 2015
- A Space-Time Graph Optimization Approach Based on Maximum Cliques for Action DetectionIEEE Transactions on Circuits and Systems for Video Technology, 2015
- Day or Night Activity Recognition From Video Using Fuzzy Clustering TechniquesIEEE Transactions on Fuzzy Systems, 2014
- Coarse to fine K nearest neighbor classifierPattern Recognition Letters, 2013
- Content-based retrieval of human actions from realistic video databasesInformation Sciences, 2013
- Human activity analysisACM Computing Surveys, 2011
- Automatic detection of diabetic retinopathy exudates from non-dilated retinal images using mathematical morphology methodsComputerized Medical Imaging and Graphics, 2008