Multi-Label Contrastive Learning for Abstract Visual Reasoning
Open Access
- 6 July 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 35 (2) , 1941-1953
Abstract
For a long time, the ability to solve abstract reasoning tasks was considered one of the hallmarks of human intelligence. Recent advances in the application of deep learning (DL) methods led to surpassing human abstract reasoning performance, specifically in the most popular type of such problems—Raven’s progressive matrices (RPMs). While the efficacy of DL systems is indeed impressive, the way they approach the RPMs is very different from that of humans. State-of-the-art systems solving RPMs rely on massive pattern-based training and sometimes on exploiting biases in the dataset, whereas humans concentrate on the identification of the rules/concepts underlying the RPM to be solved. Motivated by this cognitive difference, this work aims at combining DL with the human way of solving RPMs. Specifically, we cast the problem of solving RPMs into a multilabel classification framework where each RPM is viewed as a multilabel data point, with labels determined by the set of abstract rules underlying the RPM. For efficient training of the system, we present a generalization of the noise contrastive estimation algorithm to the case of multilabel samples and a new sparse rule encoding scheme for RPMs. The proposed approach is evaluated on the two most popular benchmark datasets I-RAVEN and procedurally generated matrices (PGM) and on both of them demonstrate an advantage over the state-of-the-art results.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Albumentations: Fast and Flexible Image AugmentationsInformation, 2020
- DeepIQ: A Human-Inspired AI System for Solving IQ Test Problems2019
- RAVEN: A Dataset for Relational and Analogical Visual REasoNing2019
- Unsupervised Feature Learning via Non-parametric Instance Discrimination2018
- CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning2017
- Modeling visual problem solving as analogical reasoning.Psychological Review, 2017
- Yin and Yang: Balancing and Answering Binary Visual Questions2016
- Distributed representations of structure: A theory of analogical access and mapping.Psychological Review, 1997
- What one intelligence test measures: A theoretical account of the processing in the Raven Progressive Matrices Test.Psychological Review, 1990
- Structure‐Mapping: A Theoretical Framework for Analogy*Cognitive Science, 1983