A Novel SURF Based on a Unified Model of Appearance and Motion-Variation
Authors:
Open Access
- 14 June 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 6, 31065-31076
Abstract
The speeded-up robust features (SURFs) algorithm is the best and most efficient local invariant feature algorithm for application to 2-D images and is widely applied in the fields of 2-D image processing and computer vision. Compared to 2-D images, a video has motion information in addition to its appearance information. Here, to make full use of the video appearance and motion information, we use geometric algebra as the mathematical calculation and analysis framework to obtain the embedded appearance and motion information on a local area of a video. In our proposed model of appearance and motion variation (UMAMV), we developed SURF feature detection and description algorithms operating on the spatio-temporal domain with video appearance and motion information. First of all, a model of appearance and motion variation, which contains video appearance and motion information in the framework of geometric algebra, is proposed. Then, based on this model, we propose a novel detection algorithm, the UMAMV-SURF detector, which mainly contains Hessian matrix construction, Hessian matrix determinant approximation calculation, and non-maximal suppression determination feature points as its key steps. Then, we introduce the UMAMV-SURF description algorithm, which mainly includes determining the dominant orientation of UMAMV-SURF feature points and generating the UMAMV-SURF feature descriptors. Finally, by experimenting with the Weizman and UCF101 datasets, the experimental results show that the proposed UMAMV-SURF algorithm can detect those SURF feature points which can have unique appearance information in the spatial domain and reflect motion change in the temporal domain. Moreover, it offers a higher accuracy than other spatio-temporal interest point algorithms in human behavior recognition of video footage.Keywords
Funding Information
- National Natural Science Foundation of China (61771319, 61401286)
- Natural Science Foundation of Guangdong Province (2017A030313343)
- Shenzhen Science and Technology Project (JCYJ20160520173822387, JCYJ20160307143441261)
This publication has 40 references indexed in Scilit:
- Long-term recurrent convolutional networks for visual recognition and description2015
- Large-Scale Video Classification with Convolutional Neural Networks2014
- Large-scale image retrieval with compressed Fisher vectors2010
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- An Efficient Dense and Scale-Invariant Spatio-Temporal Interest Point Detector2008
- Machine Learning for High-Speed Corner Detection2006
- Rapid object detection using a boosted cascade of simple features2005
- A performance evaluation of local descriptorsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- New Geometric Methods for Computer Vision: An Application to Structure and Motion EstimationInternational Journal of Computer Vision, 1998