Classification Uncertainty of Deep Neural Networks Based on Gradient Information
Authors:
- Philipp OberdiekPOPhilipp Oberdiek
- Matthias RottmannMRMatthias Rottmann
- Hanno GottschalkHGHanno Gottschalk
Preprint
Abstract
We study the quantification of uncertainty of Convolutional Neural Networks (CNNs) based on gradient metrics. Unlike the classical softmax entropy, such metrics gather information from all layers of the CNN. We show for the (E)MNIST data set that for several such metrics we achieve the same meta classification accuracy -- i.e. the task of classifying correctly predicted labels as correct and incorrectly predicted ones as incorrect without knowing the actual label -- as for entropy thresholding. Meta classification rates for out of sample images can be increased when using entropy together with several gradient based metrics as input quantities for a meta-classifier. This proves that our gradient based metrics do not contain the same information as the entropy. We also apply meta classification to concepts not used during training: EMNIST/Omniglot letters, CIFAR10 and noise. Meta classifiers only trained on the uncertainty metrics of classes available during training usually do not perform equally well for all the unknown concepts letters, CIFAR10 and uniform noise. If we however allow the meta classifier to be trained on uncertainty metrics including some samples of some or all of the categories, meta classification for concepts remote from MNIST digits can be improved considerably.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Adversarial Examples: Attacks and Defenses for Deep LearningIEEE Transactions on Neural Networks and Learning Systems, 2019
- Improving the Robustness of Deep Neural Networks via Stability Training2016
- Towards Open Set Deep Networks2016
- Human-level concept learning through probabilistic program inductionScience, 2015
- Meta-Recognition: The Theory and Practice of Recognition Score AnalysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- Stastical Decision Theory and Bayesian Analysis.Journal of the American Statistical Association, 1988