Acquiring robot skills via reinforcement learning
Authors:
- J.A. FranklinJFJ.A. Franklin
- H. BenbrahimHBH. Benbrahim
- 1 February 1994
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems
- Vol. 14 (1) , 13-24
Abstract
Skill acquisition is a difficult , yet important problem in robot performance. The authors focus on two skills, namely robotic assembly and balancing and on two classic tasks to develop these skills via learning: the peg-in hole insertion task, and the ball balancing task. A stochastic real-valued (SRV) reinforcement learning algorithm is described and used for learning control and the authors show how it can be used with nonlinear multilayer ANNs. In the peg-in-hole insertion task the SRV network successfully learns to insert to insert a peg into a hole with extremely low clearance, in spite of high sensor noise. In the ball balancing task the SRV network successfully learns to balance the ball with minimal feedback.Keywords
This publication has 18 references indexed in Scilit:
- Simple statistical gradient-following algorithms for connectionist reinforcement learningMachine Learning, 1992
- Admittance matrix design for force-guided assemblyIEEE Transactions on Robotics and Automation, 1992
- Sensor-Based Control of a Nine-Link BipedThe International Journal of Robotics Research, 1990
- A stochastic reinforcement learning algorithm for learning real-valued functionsNeural Networks, 1990
- Using Backprojections for Fine Motion Planning with UncertaintyThe International Journal of Robotics Research, 1986
- A Theory for the Three-Dimensional Mating of Chamfered Cylindrical PartsJournal of Mechanical Design, 1985
- Automatic Synthesis of Fine-Motion Strategies for RobotsThe International Journal of Robotics Research, 1984
- A self-learning automaton with variable resolution for high precision assembly by industrial robotsIEEE Transactions on Automatic Control, 1982
- Quasi-Static Assembly of Compliantly Supported Rigid PartsJournal of Dynamic Systems, Measurement, and Control, 1982
- A heuristic approach to reinforcement learning control systemsIEEE Transactions on Automatic Control, 1965