Interactive Disentanglement: Learning Concepts by Interacting with their Prototype Representations
Authors:
- 1 June 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 10307-10318
Abstract
Learning visual concepts from raw images without strong supervision is a challenging task. In this work, we show the advantages of prototype representations for understanding and revising the latent space of neural concept learners. For this purpose, we introduce interactive Concept Swapping Networks (iCSNs), a novel framework for learning concept-grounded representations via weak supervision and implicit prototype representations. iCSNs learn to bind conceptual information to specific prototype slots by swapping the latent representations of paired images. This semantically grounded and discrete latent space facilitates human understanding and human-machine interaction. We support this claim by conducting experiments on our novel data set “Elementary Concept Reasoning” (ECR), focusing on visual concepts shared by geometric objects. 1 1 Code available at: https://github.com/ml-research/ XIConceptLearningKeywords
All Related Versions
This publication has 38 references indexed in Scilit:
- You Only Look Once: Unified, Real-Time Object Detection2016
- Fast R-CNN2015
- Prototype learning and dissociable categorization systems in Alzheimer's diseaseNeuropsychologia, 2013
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Categorization as Causal Explanation2013
- Generalization and similarity in exemplar models of categorization: Insights from machine learningPsychonomic Bulletin & Review, 2008
- The Role of Prototypes in the Mental Representation of Temporally Related EventsCognitive Psychology, 2002
- Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions.Psychological Review, 1990
- Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem1989
- THE PSYCHOLOGICAL NATURE OF CONCEPTS1966