WarpNet: Weakly Supervised Matching for Single-View Reconstruction
Authors:
- Angjoo KanazawaAKAngjoo Kanazawa
- David W. JacobsDJDavid W. Jacobs
- Manmohan ChandrakerMCManmohan Chandraker
- 1 June 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3253-3261
Abstract
We present an approach to matching images of objects in fine-grained datasets without using part annotations, with an application to the challenging problem of weakly supervised single-view reconstruction. This is in contrast to prior works that require part annotations, since matching objects across class and pose variations is challenging with appearance features alone. We overcome this challenge through a novel deep learning architecture, WarpNet, that aligns an object in one image with a different object in another. We exploit the structure of the fine-grained dataset to create artificial data for training this network in an unsupervised-discriminative learning approach. The output of the network acts as a spatial prior that allows generalization at test time to match real images across variations in appearance, viewpoint and articulation. On the CUB-200-2011 dataset of bird categories, we improve the AP over an appearance-only network by 13.6%. We further demonstrate that our WarpNet matches, together with the structure of fine-grained datasets, allow single-view reconstructions with quality comparable to using annotated point correspondences.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- Reconstructing PASCAL VOC2014
- How Do You Tell a Blackbird from a Crow?2013
- Deformable Spatial Pyramid Matching for Fast Dense Correspondences2013
- Dense Object Reconstruction with Semantic Priors2013
- A Method for Visualizing Pedestrian Traffic Flow Using SIFT Feature Point TrackingLecture Notes in Computer Science, 2009
- Estimating 3D shape from degenerate sequences with missing dataComputer Vision and Image Understanding, 2008
- Modeling the World from Internet Photo CollectionsInternational Journal of Computer Vision, 2007
- Learning a Similarity Metric Discriminatively, with Application to Face Verification2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Shape matching and object recognition using shape contextsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002