Hyperspectral open set classification with unknown classes rejection towards deep networks
- 9 June 2020
- journal article
- research article
- Published by Taylor & Francis in International Journal of Remote Sensing
- Vol. 41 (16) , 6355-6383
Abstract
Recent research in deep learning has significantly improved the performance of hyperspectral classification. However, nearly all experimental evaluations based on deep networks have taken the form of ‘closed set’, where all testing classes are known in training time. Obviously, it is unreasonable for real-world-applications, where unknown classes in training time may appear during testing. The realistic scenarios require classifiers not only to classify the known classes, but to reject the unknown classes, which is referred as open set classification (OSC). Considering the increased applications in real world, the adaption of deep networks-based methods towards OSC can be of vital importance. Unfortunately, it has not been well addressed by existing deep network-based algorithms. To tackle it, we present a method based on deep networks for hyperspectral OSC, by introducing an OpenMax layer which can estimate the probability of an input being from unknown classes and classify known classes. Experiments conducted on five hyperspectral datasets show that the number of misclassifications of the unknowns made by traditional three-dimensional Convolutional Neural Network (CNN) can be reduced significantly using proposed method. This paper highlights the open set challenge in hyperspectral classification and verifies the effectiveness of OpenMax method for solving such problem.Keywords
Funding Information
- National Natural Science Foundation of China (11802339, 11804387, 11805276, 61801498, 61805282)
- National Natural Science Foundation of Hunan Province (2016JJ1021)
- Scientific Researches Foundation of National University of Defence Technology (ZK16-03-59, ZK18-01-03, ZK18-03-22, ZK18-03-36)
- The Youth talent lifting project (17-JCJQ-QT-004)
This publication has 40 references indexed in Scilit:
- Supervised hyperspectral image classification with rejection2015
- Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief NetworkIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015
- Intrinsic Image Decomposition for Feature Extraction of Hyperspectral ImagesIEEE Transactions on Geoscience and Remote Sensing, 2014
- Probability Models for Open Set RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving FilteringIEEE Transactions on Geoscience and Remote Sensing, 2013
- Toward Open Set RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Robust Fusion: Extreme Value Theory for Recognition Score Normalization2010
- Bertrand's Paradox and the Principle of IndifferencePhilosophy of Science, 2007
- Open Issues in Pattern Recognition2004
- Bilateral filtering for gray and color images2002