Deep Multiple Instance Learning-Based Spatial–Spectral Classification for PAN and MS Imagery
- 22 September 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 56 (1) , 461-473
Abstract
Panchromatic (PAN) and multispectral (MS) imagery classification is one of the hottest topics in the field of remote sensing. In recent years, deep learning techniques have been widely applied in many areas of image processing. In this paper, an end-to-end learning framework based on deep multiple instance learning (DMIL) is proposed for MS and PAN images' classification using the joint spectral and spatial information based on feature fusion. There are two instances in the proposed framework: one instance is used to capture the spatial information of PAN and the other is used to describe the spectral information of MS. The features obtained by the two instances are concatenated directly, which can be treated as simple fusion features. To fully fuse the spatial-spectral information for further classification, the simple fusion features are fed into a fusion network with three fully connected layers to learn the high-level fusion features. Classification experiments carried out on four different airborne MS and PAN images indicate that the classifier provides feasible and efficient solution. It demonstrates that DMIL performs better than using a convolutional neural network and a stacked autoencoder network separately. In addition, this paper shows that the DMIL model can learn and fuse spectral and spatial information effectively, and has huge potential for MS and PAN imagery classification.Keywords
Funding Information
- National Basic Research Program (973 Program) of China (2013CB329402)
- Major Research Plan of the National Natural Science Foundation of China (91438201, 91438103)
- Fund for Foreign Scholars in University Research and Teaching Programs (the 111 Project) (B07048)
This publication has 43 references indexed in Scilit:
- A Survey on Spectral–Spatial Classification Techniques Based on Attribute ProfilesIEEE Transactions on Geoscience and Remote Sensing, 2014
- Deep Learning-Based Classification of Hyperspectral DataIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014
- Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disordersComputers in Biology and Medicine, 2013
- Riparian Vegetation Mapping for Hydraulic Roughness Estimation Using Very High Resolution Remote Sensing Data FusionJournal of Hydraulic Engineering, 2010
- Learning Deep Architectures for AIFoundations and Trends in Machine Learning, 2009
- Comparison of Nine Fusion Techniques for Very High Resolution DataPhotogrammetric Engineering & Remote Sensing, 2008
- Influence of image fusion approaches on classification accuracy: a case studyInternational Journal of Remote Sensing, 2006
- Strategies for Integrating Information from Multiple Spatial Resolutions into Land-Use/Land-Cover Classification RoutinesPhotogrammetric Engineering & Remote Sensing, 2003
- Combining multispectral data of differing spatial resolutionIEEE Transactions on Geoscience and Remote Sensing, 1999
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998