Analysis of Human Learning Process on Manual Control of Complex Systems
- 1 October 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 1648-1653
Abstract
In this paper, a novel analysis technique is applied for investigating human operators' trial and error learning process to control a nonholonomic system, 2-link planer underactuated manipulator (2PUAM). An essential core of the technique is to use a value function of the reinforcement learning scheme for revealing how the operators can find a control strategy. It is an advantage of the proposed technique compared to the others that a transition of the value function may explain the changes of the operators' strategies during the learning process. According to the results of the analysis, the operators tended to explore an objective trajectory first, and then shift to the tracking control of the trajectory. The tracking was accompanied with acceleration to achieve the goal faster. Interestingly, the acceleration disturbs the objective trajectory due to the complex dynamics of the target, and induces another exploration to get better trajectories. The fact that this phase transition structure under unsupervised learning environment is consistent with previously reported results for a supervised case implies that the structure can be a general nature of human learning process.Keywords
This publication has 8 references indexed in Scilit:
- Free-joint manipulators: motion control under second-order nonholonomic constraints2002
- Neural mechanisms of learning and controlIEEE Control Systems, 2001
- Stabilization of an underactuated planar 2R manipulatorInternational Journal of Robust and Nonlinear Control, 2000
- Reinforcement Learning in Continuous Time and SpaceNeural Computation, 2000
- Time‐scaling control of an underactuated manipulatorJournal of Robotic Systems, 1998
- Behavior Analysis and Control by Amplitude Modulation of Nonholonomic Mechanical Systems via the Averaging Method. Positioning Control of Planar 2R Free-Joint Manipulators.Journal of the Robotics Society of Japan, 1998
- Experimental studies of manual optimization in control tasksIEEE Control Systems Magazine, 1990
- An optimal control model of human response part I: Theory and validationAutomatica, 1970