Towards Deep Developmental Learning
Authors:
- 30 October 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive and Developmental Systems
- Vol. 8 (2) , 99-114
Abstract
Deep learning techniques are having an undeniable impact on general pattern recognition issues. In this paper, from a developmental robotics perspective, we scrutinize deep learning techniques under the light of their capability to construct a hierarchy of meaningful multimodal representations from the raw sensors of robots. These investigations reveal the differences between the methodological constraints of pattern recognition and those of developmental robotics. In particular, we outline the necessity to rely on unsupervised rather than supervised learning methods and we highlight the need for progress towards the implementation of hierarchical predictive processing capabilities. Based on these new tools, we outline the emergence of a new domain that we call deep developmental learning.Keywords
Funding Information
- Cordis (FP7-ICT-2011-9 No.600716, No 640891)
This publication has 100 references indexed in Scilit:
- A Deep Learning Neural Network for Number Cognition: A bi-cultural study with the iCub2015
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Emergence of a 'visual number sense' in hierarchical generative modelsNature Neuroscience, 2012
- Exploring speaker-specific characteristics with deep learning2011
- Discriminative feature extraction with Deep Neural Networks2010
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- An Introduction to Support Vector Machines and Other Kernel-based Learning Methods2000
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Learning long-term dependencies with gradient descent is difficultIEEE Transactions on Neural Networks, 1994
- Multilayer feedforward networks are universal approximatorsNeural Networks, 1989