Predictive Coding-based Deep Dynamic Neural Network for Visuomotor Learning
Preprint
Abstract
This study presents a dynamic neural network model based on the predictive coding framework for perceiving and predicting the dynamic visuo-proprioceptive patterns. In our previous study [1], we have shown that the deep dynamic neural network model was able to coordinate visual perception and action generation in a seamless manner. In the current study, we extended the previous model under the predictive coding framework to endow the model with a capability of perceiving and predicting dynamic visuo-proprioceptive patterns as well as a capability of inferring intention behind the perceived visuomotor information through minimizing prediction error. A set of synthetic experiments were conducted in which a robot learned to imitate the gestures of another robot in a simulation environment. The experimental results showed that with given intention states, the model was able to mentally simulate the possible incoming dynamic visuo-proprioceptive patterns in a top-down process without the inputs from the external environment. Moreover, the results highlighted the role of minimizing prediction error in inferring underlying intention of the perceived visuo-proprioceptive patterns, supporting the predictive coding account of the mirror neuron systems. The results also revealed that minimizing prediction error in one modality induced the recall of the corresponding representation of another modality acquired during the consolidative learning of raw-level visuo-proprioceptive patterns.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- How can a recurrent neurodynamic predictive coding model cope with fluctuation in temporal patterns? Robotic experiments on imitative interactionNeural Networks, 2017
- A Neural Architecture for Performing Actual and Mentally Simulated Movements During Self-Intended and Observed Bimanual Arm Reaching MovementsInternational Journal of Social Robotics, 2015
- The free-energy principle: a unified brain theory?Nature Reviews Neuroscience, 2010
- Development of hierarchical structures for actions and motor imagery: a constructivist view from synthetic neuro-robotics studyPsychological Research, 2009
- Predictive coding: an account of the mirror neuron systemCognitive Processing, 2007
- A free energy principle for the brainJournal of Physiology-Paris, 2006
- Understanding and sharing intentions: The origins of cultural cognitionBehavioral and Brain Sciences, 2005
- Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effectsNature Neuroscience, 1999
- Action recognition in the premotor cortexBrain, 1996
- Understanding motor events: a neurophysiological studyExperimental Brain Research, 1992