Uninformed Students: Student-Teacher Anomaly Detection With Discriminative Latent Embeddings
Authors:
Top Cited Papers
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4182-4191
Abstract
We introduce a powerful student-teacher framework for the challenging problem of unsupervised anomaly detection and pixel-precise anomaly segmentation in high-resolution images. Student networks are trained to regress the output of a descriptive teacher network that was pretrained on a large dataset of patches from natural images. This circumvents the need for prior data annotation. Anomalies are detected when the outputs of the student networks differ from that of the teacher network. This happens when they fail to generalize outside the manifold of anomaly-free training data. The intrinsic uncertainty in the student networks is used as an additional scoring function that indicates anomalies. We compare our method to a large number of existing deep learning based methods for unsupervised anomaly detection. Our experiments demonstrate improvements over state-of-the-art methods on a number of real-world datasets, including the recently introduced MVTec Anomaly Detection dataset that was specifically designed to benchmark anomaly segmentation algorithms.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networksMedical Image Analysis, 2019
- Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoders2019
- Deep-anomaly: Fully convolutional neural network for fast anomaly detection in crowded scenesComputer Vision and Image Understanding, 2018
- The Power of Ensembles for Active Learning in Image Classification2018
- Anomaly Detection in Nanofibrous Materials by CNN-Based Self-SimilaritySensors, 2018
- L2-Net: Deep Learning of Discriminative Patch Descriptor in Euclidean Space2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- A review of novelty detectionSignal Processing, 2014
- Dimensionality Reduction by Learning an Invariant Mapping2006
- Modern Multidimensional Scaling: Theory and ApplicationsJournal of Educational Measurement, 2003