University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localization
Authors:
- Zhedong ZhengZZZhedong Zheng
- Yunchao WeiYWYunchao Wei
- Yi YangYYYi Yang
Preprint
Abstract
We consider the problem of cross-view geo-localization. The primary challenge of this task is to learn the robust feature against large viewpoint changes. Existing benchmarks can help, but are limited in the number of viewpoints. Image pairs, containing two viewpoints, e.g., satellite and ground, are usually provided, which may compromise the feature learning. Besides phone cameras and satellites, in this paper, we argue that drones could serve as the third platform to deal with the geo-localization problem. In contrast to the traditional ground-view images, drone-view images meet fewer obstacles, e.g., trees, and could provide a comprehensive view when flying around the target place. To verify the effectiveness of the drone platform, we introduce a new multi-view multi-source benchmark for drone-based geo-localization, named University-1652. University-1652 contains data from three platforms, i.e., synthetic drones, satellites and ground cameras of 1,652 university buildings around the world. To our knowledge, University-1652 is the first drone-based geo-localization dataset and enables two new tasks, i.e., drone-view target localization and drone navigation. As the name implies, drone-view target localization intends to predict the location of the target place via drone-view images. On the other hand, given a satellite-view query image, drone navigation is to drive the drone to the area of interest in the query. We use this dataset to analyze a variety of off-the-shelf CNN features and propose a strong CNN baseline on this challenging dataset. The experiments show that University-1652 helps the model to learn the viewpoint-invariant features and also has good generalization ability in the real-world scenario.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Lending Orientation to Neural Networks for Cross-View Geo-Localization2019
- Progressive Learning for Person Re-Identification With One ExampleIEEE Transactions on Image Processing, 2019
- Fine-Tuning CNN Image Retrieval with No Human AnnotationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- Revisiting Oxford and Paris: Large-Scale Image Retrieval Benchmarking2018
- Triplet-Based Deep Hashing Network for Cross-Modal RetrievalIEEE Transactions on Image Processing, 2018
- A Discriminatively Learned CNN Embedding for Person ReidentificationACM Transactions on Multimedia Computing, Communications, and Applications, 2017
- Places: A 10 Million Image Database for Scene RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Large Scale Online Learning of Image Similarity through Ranking2009
- Lost in quantization: Improving particular object retrieval in large scale image databases2008
- Object retrieval with large vocabularies and fast spatial matching2007