Unsupervised learning of target attraction for robots through Spike Timing Dependent Plasticity
- 1 December 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 0428-0433
Abstract
In this paper, unsupervised learning of robots through Spiking Neural Network (SNN) is studied. Izhikevich model is used for building spiking neural network and kinematic model of the robots is considered for body modeling. Learning mechanism is based on Spike Timing Dependent Plasticity (STDP) in which variation of synapses between neurons depends on spike timing. The reciprocal architecture of network as well as timing regulation of algorithm result in tuning of spiking neural network which makes robot to be attracted to the target. It is supposed that the robot has two sensors for target detection. Signals from sensors are conducted into neural network, so that the output of network (spikes of motor neurons) derive the actuators. Neurons that fire together make special pathways from sensory neurons to motor neurons, and other synapses which are not involved, are weakened slowly. The algorithm of proposed method is illustrated and we designed two sets of simulation studies in order to test the effectiveness of the proposed method: the learning of target attraction for 1) mobile robot, 2) one-DOF robotic arm.Keywords
This publication has 24 references indexed in Scilit:
- Mobile robots׳ modular navigation controller using spiking neural networksNeurocomputing, 2014
- Reinforcement Learning of Two-Joint Virtual Arm Reaching in a Computer Model of Sensorimotor CortexNeural Computation, 2013
- Reinforcement Learning of Targeted Movement in a Spiking Neuronal Model of Motor CortexPLOS ONE, 2012
- Evolving spiking neural networks for robot controlProcedia Computer Science, 2011
- ADAPTIVE CEREBELLAR SPIKING MODEL EMBEDDED IN THE CONTROL LOOP: CONTEXT SWITCHING AND ROBUSTNESS AGAINST NOISEInternational Journal of Neural Systems, 2011
- Maximum load determination of nonholonomic mobile manipulator using hierarchical optimal controlRobotica, 2011
- A real-time spiking cerebellum model for learning robot controlBioSystems, 2008
- A behavior controller based on spiking neural networks for mobile robotsNeurocomputing, 2008
- Solving the Distal Reward Problem through Linkage of STDP and Dopamine SignalingCerebral Cortex, 2007
- Simple model of spiking neuronsIEEE Transactions on Neural Networks, 2003