A Novel Lightweight Approach for Video Retrieval on Mobile Augmented Reality Environment
Open Access
- 10 October 2018
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 8 (10) , 1860
Abstract
Mobile Augmented Reality merges the virtual objects with real world on mobile devices, while video retrieval brings out the similar looking videos from the large-scale video dataset. Since mobile augmented reality application demands the real-time interaction and operation, we need to process and interact in real-time. Furthermore, augmented reality based virtual objects can be poorly textured. In order to resolve the above mentioned issues, in this research, we propose a novel, fast and robust approach for retrieving videos on the mobile augmented reality environment using an image and video queries. In the beginning, Top-K key-frames are extracted from the videos which significantly increases the efficiency. Secondly, we introduce a novel frame based feature extraction method, namely Pyramid Ternary Histogram of Oriented Gradient (PTHOG) to extract the shape feature from the virtual objects in an effective and efficient manner. Thirdly, we utilize the Double-Bit Quantization (DBQ) based hashing to accomplish the nearest neighbor search efficiently, which produce the candidate list of videos. Lastly, the similarity measure is performed to re-rank the videos which are obtained from the candidate list. An extensive experimental analysis is performed in order to verify our claims.Keywords
Funding Information
- This research was supported by the MSIT(Ministry of Science and ICT), Korea, under the ITRC(Information Technology Research Center) support program(IITP-2018-2013-0-00717) supervised by the IITP(Institute for Information & communications Technology Pr (IITP-2018-2013-0-00717)
This publication has 27 references indexed in Scilit:
- Design of mobile augmented reality game based on image recognitionEURASIP Journal on Image and Video Processing, 2017
- Markerless tracking system for augmented reality in the automotive industryExpert Systems with Applications, 2017
- A State-of-the-Art Review of Augmented Reality in Engineering Analysis and SimulationMultimodal Technologies and Interaction, 2017
- A Mobile Outdoor Augmented Reality Method Combining Deep Learning Object Detection and Spatial Relationships for GeovisualizationSensors, 2017
- Mobile Augmented Reality Survey: From Where We Are to Where We GoIEEE Access, 2017
- An improved augmented reality system based on AndARJournal of Visual Communication and Image Representation, 2016
- Large-scale video copy retrieval with temporal-concentration SIFTNeurocomputing, 2016
- Interframe Coding of Feature Descriptors for Mobile Augmented RealityIEEE Transactions on Image Processing, 2014
- Efficient matchings and mobile augmented realityACM Transactions on Multimedia Computing, Communications, and Applications, 2012
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004