Active key frame selection for 3D model reconstruction from crowdsourced geo-tagged videos
- 1 July 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 19457871,p. 1-6
Abstract
Automatic reconstruction of 3D models is attracting increasing attention in the multimedia community. Scene recovery from video sequences requires a selection of representative video frames. Most prior work adopted content-based techniques to automate key frame extraction. However, these methods take no frame geo-information into consideration and are still compute-intensive. Here we propose a new approach for key frame selection based on the geographic properties of videos. Currently, an increasing number of user-generated videos (UGVs) are collected - a trend that is driven by the ubiquitous availability of smartphones. Additionally, it has become easy to continuously acquire and fuse various sensor data (e.g., geo-spatial metadata) with video to create geo-tagged mobile videos. Our novel technique utilizes these underlying geo-metadata to select the most representative frames. Specifically, a key frame subset with minimal spatial coverage gain difference is extracted by incorporating a manifold structure into reproducing a kernel Hilbert space to analyze the spatial relationship among the frames. Our experimental results illustrate that the execution time of the 3D reconstruction is shortened while the model quality is preserved.Keywords
This publication has 14 references indexed in Scilit:
- Representative Discovery of Structure Cues for Weakly-Supervised Image SegmentationIEEE Transactions on Multimedia, 2013
- Motch2012
- Design and implementation of geo-tagged video search frameworkJournal of Visual Communication and Image Representation, 2010
- Optimal keyframe selection algorithm for three-dimensional reconstruction in uncalibrated multiple imagesOptical Engineering, 2008
- Multi-View Stereo for Community Photo Collections2007
- Active learning via transductive experimental design2006
- A quasi-dense approach to surface reconstruction from uncalibrated imagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Convex Optimization2004
- 3D face reconstruction from video using a generic model2003
- Geometric motion segmentation and model selectionPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 1998