Large-Scale Aerial Image Categorization Using a Multitask Topological Codebook
Authors:
- 16 March 2015
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 46 (2) , 535-545
Abstract
Fast and accurately categorizing the millions of aerial images on Google Maps is a useful technique in pattern recognition. Existing methods cannot handle this task successfully due to two reasons: 1) the aerial images' topologies are the key feature to distinguish their categories, but they cannot be effectively encoded by a conventional visual codebook and 2) it is challenging to build a realtime image categorization system, as some geo-aware Apps update over 20 aerial images per second. To solve these problems, we propose an efficient aerial image categorization algorithm. It focuses on learning a discriminative topological codebook of aerial images under a multitask learning framework. The pipeline can be summarized as follows. We first construct a region adjacency graph (RAG) that describes the topology of each aerial image. Naturally, aerial image categorization can be formulated as RAG-to-RAG matching. According to graph theory, RAG-to-RAG matching is conducted by enumeratively comparing all their respective graphlets (i.e., small subgraphs). To alleviate the high time consumption, we propose to learn a codebook containing topologies jointly discriminative to multiple categories. The learned topological codebook guides the extraction of the discriminative graphlets. Finally, these graphlets are integrated into an AdaBoost model for predicting aerial image categories. Experimental results show that our approach is competitive to several existing recognition models. Furthermore, over 24 aerial images are processed per second, demonstrating that our approach is ready for real-world applications.Keywords
Funding Information
- National 973 Program of China (2014CB347600)
- National Natural Science Foundation of China (61272393, 61322201, 61125106)
- Program for New Century Excellent Talents in University (NCET-12-0836)
- Key Research Program of the Chinese Academy of Sciences (KGZD-EW-T03)
This publication has 45 references indexed in Scilit:
- Efficient semi-supervised feature selection with noise insensitive trace ratio criterionNeurocomputing, 2013
- Object categorization with sketch representation and generalized samplesPattern Recognition, 2012
- A stochastic graph grammar for compositional object representation and recognitionPattern Recognition, 2009
- Joint covariate selection and joint subspace selection for multiple classification problemsStatistics and Computing, 2009
- Multi-class AdaBoostStatistics and Its Interface, 2009
- Embedding new data points for manifold learning via coordinate propagationKnowledge and Information Systems, 2008
- Convex multi-task feature learningMachine Learning, 2008
- Object Recognition as Many-to-Many Feature MatchingInternational Journal of Computer Vision, 2006
- Pictorial Structures for Object RecognitionInternational Journal of Computer Vision, 2005
- On the mean accuracy of statistical pattern recognizersIEEE Transactions on Information Theory, 1968