Development of Few-Shot Learning Capabilities in Artificial Neural Networks When Learning Through Self-Supervised Interaction
Open Access
- 9 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 46 (1) , 209-219
Abstract
Most artificial neural networks used for object recognition are trained in a fully supervised setup. This is not only resource consuming as it requires large data sets of labeled examples but also quite different from how humans learn. We use a setup in which an artificial agent first learns in a simulated world through self-supervised, curiosity-driven exploration. Following this initial learning phase, the learned representations can be used to quickly associate semantic concepts such as different types of doors using one or more labeled examples. To do this, we use a method we call fast concept mapping which uses correlated firing patterns of neurons to define and detect semantic concepts. This association works instantaneously with very few labeled examples, similar to what we observe in humans in a phenomenon called fast mapping . Strikingly, we can already identify objects with as little as one labeled example which highlights the quality of the encoding learned self-supervised through interaction with the world. It therefore presents a feasible strategy for learning concepts without much supervision and shows that through pure interaction meaningful representations of an environment can be learned that work better for few-short learning than non-interactive methods.Keywords
Funding Information
- DFG (GRK2340)
This publication has 22 references indexed in Scilit:
- Deep convolutional networks do not classify based on global object shapePLOS Computational Biology, 2018
- A strategy to apply machine learning to small datasets in materials sciencenpj Computational Materials, 2018
- Curiosity-Driven Exploration by Self-Supervised Prediction2017
- Effects of Variation and Prior Knowledge on Abstract Concept LearningCognition and Instruction, 2015
- Rapid Learning in a Children's Museum via Analogical ComparisonCognitive Science, 2015
- Where's the action? The pragmatic turn in cognitive scienceTrends in Cognitive Sciences, 2013
- Rapid word learning in 13- and 17-month-olds in a naturalistic two-word procedure: Looking versus reaching measuresJournal of Experimental Child Psychology, 2011
- Fast Mapping but Poor Retention by 24‐Month‐Old InfantsInfancy, 2008
- Word Learning in a Domestic Dog: Evidence for "Fast Mapping"Science, 2004
- The origins of intelligence in children.1952