Learned Contextual Feature Reweighting for Image Geo-Localization
Authors:
- Hyo Jin KimHKHyo Jin Kim
- Enrique DunnEDEnrique Dunn
- Jan-Michael FrahmJFJan-Michael Frahm
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 3251-3260
Abstract
We address the problem of large scale image geo-localization where the location of an image is estimated by identifying geo-tagged reference images depicting the same place. We propose a novel model for learning image representations that integrates context-aware feature reweighting in order to effectively focus on regions that positively contribute to geo-localization. In particular, we introduce a Contextual Reweighting Network (CRN) that predicts the importance of each region in the feature map based on the image context. Our model is learned end-to-end for the image geo-localization task, and requires no annotation other than image geo-tags for training. In experimental results, the proposed approach significantly outperforms the previous state-of-the-art on the standard geo-localization benchmark datasets. We also demonstrate that our CRN discovers task-relevant contexts without any additional supervision.Keywords
This publication has 48 references indexed in Scilit:
- PlaNet - Photo Geolocation with Convolutional Neural Networks2016
- Unsupervised Learning of Visual Representations Using Videos2015
- Learning deep representations for ground-to-aerial geolocalization2015
- Semantically guided location recognition for outdoors scenes2015
- Learning Fine-Grained Image Similarity with Deep Ranking2014
- Scalable 6-DOF Localization on Mobile Devices2014
- Worldwide Pose Estimation Using 3D Point Clouds2012
- Location Recognition Using Prioritized Feature Matching2010
- The role of context in object recognitionTrends in Cognitive Sciences, 2007
- Object recognition from local scale-invariant features1999