University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localization
Authors:
Top Cited Papers
Open Access
- 12 October 2020
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1395-1403
Abstract
We consider the problem of cross-view geo-localization. The primary challenge is to learn the robust feature against large viewpoint changes. Existing benchmarks can help, but are limited in the number of viewpoints. Image pairs, containing two viewpoints, e.g., satellite and ground, are usually provided, which may compromise the feature learning. Besides phone cameras and satellites, in this paper, we argue that drones could serve as the third platform to deal with the geo-localization problem. In contrast to traditional ground-view images, drone-view images meet fewer obstacles, e.g., trees, and provide a comprehensive view when flying around the target place. To verify the effectiveness of the drone platform, we introduce a new multi-view multi-source benchmark for drone-based geo-localization, named University-1652. University-1652 contains data from three platforms, i.e., synthetic drones, satellites and ground cameras of 1,652 university buildings around the world. To our knowledge, University-1652 is the first drone-based geo-localization dataset and enables two new tasks, i.e., drone-view target localization and drone navigation. As the name implies, drone-view target localization intends to predict the location of the target place via drone-view images. On the other hand, given a satellite-view query image, drone navigation is to drive the drone to the area of interest in the query. We use this dataset to analyze a variety of off-the-shelf CNN features and propose a strong CNN baseline on this challenging dataset. The experiments show that University-1652 helps the model to learn viewpoint-invariant features and also has good generalization ability in real-world scenarios.Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- Localizing and Orienting Street Views Using Overhead Imagery2016
- Playing for Data: Ground Truth from Computer Games2016
- The Unreasonable Effectiveness of Noisy Data for Fine-Grained Recognition2016
- Deep Metric Learning via Lifted Structured Feature Embedding2016
- NetVLAD: CNN Architecture for Weakly Supervised Place Recognition2016
- Wide-Area Image Geolocalization with Aerial Reference Imagery2015
- On the location dependence of convolutional neural network features2015
- Learning deep representations for ground-to-aerial geolocalization2015
- 24/7 place recognition by view synthesis2015
- Object retrieval with large vocabularies and fast spatial matching2007