Toward Open-Set Face Recognition
Authors:
- Manuel GuntherMGManuel Gunther
- Steve CruzSCSteve Cruz
- Ethan M. RuddEREthan M. Rudd
- Terrance E. BoultTBTerrance E. Boult
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 573-582
Abstract
Much research has been conducted on both face identification and face verification, with greater focus on the latter. Research on face identification has mostly focused on using closed-set protocols, which assume that all probe images used in evaluation contain identities of subjects that are enrolled in the gallery. Real systems, however, where only a fraction of probe sample identities are enrolled in the gallery, cannot make this closed-set assumption. Instead, they must assume an open set of probe samples and be able to reject/ignore those that correspond to unknown identities. In this paper, we address the widespread misconception that thresholding verification-like scores is a good way to solve the open-set face identification problem, by formulating an open-set face identification protocol and evaluating different strategies for assessing similarity. Our open-set identification protocol is based on the canonical labeled faces in the wild (LFW) dataset. Additionally to the known identities, we introduce the concepts of known unknowns (known, but uninteresting persons) and unknown unknowns (people never seen before) to the biometric community. We compare three algorithms for assessing similarity in a deep feature space under an open-set protocol: thresholded verification-like scores, linear discriminant analysis (LDA) scores, and an extreme value machine (EVM) probabilities. Our findings suggest that thresholding EVM probabilities, which are open-set by design, outperforms thresholding verification-like scores.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Unconstrained Face Recognition: Identifying a Person of Interest From a Media CollectionIEEE Transactions on Information Forensics and Security, 2014
- Probability Models for Open Set RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Toward Open Set RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Evaluation Methods in Face Recognition2011
- Open-Set Face Recognition-Based Visitor Interface System2009
- A Survey on 3D Modeling of Human Faces for Face Recognition2007
- Face Recognition Vendor Test 2002 Performance Metrics2003
- Score Normalization for Text-Independent Speaker Verification SystemsDigital Signal Processing, 2000
- Discriminant Analysis of Principal Components for Face Recognition1998
- Limiting forms of the frequency distribution of the largest or smallest member of a sampleMathematical Proceedings of the Cambridge Philosophical Society, 1928