Generalised Zero-Shot Learning with Domain Classification in a Joint Semantic and Visual Space
Open Access
- 1 December 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. abs 1707 6, 1-8
Abstract
Generalised zero-shot learning (GZSL) is a classification problem where the learning stage relies on a set of seen visual classes and the inference stage aims to identify both the seen visual classes and a new set of unseen visual classes. Critically, both the learning and inference stages can leverage a semantic representation that is available for the seen and unseen classes. Most state-of-the-art GZSL approaches rely on a mapping between latent visual and semantic spaces without considering if a particular sample belongs to the set of seen or unseen classes. In this paper, we propose a novel GZSL method that learns a joint latent representation that combines both visual and semantic information. This mitigates the need for learning a mapping between the two spaces. Our method also introduces a domain classification that estimates whether a sample belongs to a seen or an unseen class. Our classifier then combines a class discriminator with this domain classifier with the goal of reducing the natural bias that GZSL approaches have toward the seen classes. Experiments show that our method achieves state-of-the-art results in terms of harmonic mean, the area under the seen and unseen curve and unseen classification accuracy on public GZSL benchmark data sets. Our code will be available upon acceptance of this paper.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Semantic Autoencoder for Zero-Shot Learning2017
- An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wild2016
- Synthesized Classifiers for Zero-Shot Learning2016
- Deep Residual Learning for Image Recognition2016
- Learning Deep Representations of Fine-Grained Visual Descriptions2016
- Latent Embeddings for Zero-Shot Classification2016
- Label-Embedding for Image ClassificationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Evaluation of output embeddings for fine-grained image classification2015
- Attribute-Based Classification for Zero-Shot Visual Object CategorizationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Learning to detect unseen object classes by between-class attribute transfer2009