Takakuni Goto
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Takakuni Goto has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
Kenichi Abe
Nihon University
2 shared publicationsMakoto Yoshizawa
Tohoku University
2 shared publicationsNoriyasu Homma
Tohoku University
2 shared publications- Kenichi Abe
Department of Computer Science, College of Engineering, Nihon University, Koriyama, Fukushima-Ken, 963-8642, Japan
1 shared publication - Makoto Yoshizawa
Cyberscience center, Tohoku University, 13101 Sendai, Miyagi Japan
1 shared publication - Noriyasu Homma
Department of Radiological Imaging and Informatics, Tohoku University Graduate School of Medicine, Sendai, Japan
1 shared publication
Latest Publications
- 25 July 2007
- Published by Springer Nature in Artificial Life and Robotics
- Vol. 11 (2) , 190-196
A phased reinforcement learning algorithm for complex control problems
- 25 July 2007
- Published by Springer Nature in Artificial Life and Robotics
- Vol. 11 (2) , 190-196
A phased reinforcement learning algorithm for complex control problems
- 1 October 2006
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 1648-1653
Analysis of Human Learning Process on Manual Control of Complex Systems
In this paper, a novel analysis technique is applied for investigating human operators' trial and error learning process to control a nonholonomic system, 2-link planer underactuated manipulator (2PUAM). An essential core of the technique is to use a value function of the reinforcement learning scheme for revealing how the operators can find a control strategy. It is an advantage of the proposed technique compared to the others that a transition of the value function may explain the changes of the operators' strategies during the learning process. According to the results of the analysis, the operators tended to explore an objective trajectory first, and then shift to the tracking control of the trajectory. The tracking was accompanied with acceleration to achieve the goal faster. Interestingly, the acceleration disturbs the objective trajectory due to the complex dynamics of the target, and induces another exploration to get better trajectories. The fact that this phase transition structure under unsupervised learning environment is consistent with previously reported results for a supervised case implies that the structure can be a general nature of human learning process.
- 1 October 2006
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 1648-1653
Analysis of Human Learning Process on Manual Control of Complex Systems
In this paper, a novel analysis technique is applied for investigating human operators' trial and error learning process to control a nonholonomic system, 2-link planer underactuated manipulator (2PUAM). An essential core of the technique is to use a value function of the reinforcement learning scheme for revealing how the operators can find a control strategy. It is an advantage of the proposed technique compared to the others that a transition of the value function may explain the changes of the operators' strategies during the learning process. According to the results of the analysis, the operators tended to explore an objective trajectory first, and then shift to the tracking control of the trajectory. The tracking was accompanied with acceleration to achieve the goal faster. Interestingly, the acceleration disturbs the objective trajectory due to the complex dynamics of the target, and induces another exploration to get better trajectories. The fact that this phase transition structure under unsupervised learning environment is consistent with previously reported results for a supervised case implies that the structure can be a general nature of human learning process.
- 1 January 2006
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4557-4562
Phased Learning with Hierarchical Reinforcement Learning in Nonholonomic Motion Control
In this paper, a hierarchical reinforcement learning algorithm for controlling nonholonomic systems is proposed. When applying reinforcement learning to the nonholonomic systems, acquiring adequate policies is difficult because of an increase of learning steps and a convergence of local optimal policies. The proposed algorithm is inspired by such human learning behavior. Human can learn to control such systems sufficiently even if they initially have little knowledge about the system's dynamics and the way to control. This human capability is suggested to be caused by their exploration strategies for acquiring the adequate policies. The key element of the proposed algorithm is a shaping function defined on a novel position-direction space. The shaping function is autonomously constructed once the goal is reached and constrains the exploration area to optimize the policy. The efficiency of the proposed shaping function was demonstrated by using a nonholonomic control problem of positioning the 2-link planer underactuated manipulator
- 1 January 2006
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4557-4562
Phased Learning with Hierarchical Reinforcement Learning in Nonholonomic Motion Control
In this paper, a hierarchical reinforcement learning algorithm for controlling nonholonomic systems is proposed. When applying reinforcement learning to the nonholonomic systems, acquiring adequate policies is difficult because of an increase of learning steps and a convergence of local optimal policies. The proposed algorithm is inspired by such human learning behavior. Human can learn to control such systems sufficiently even if they initially have little knowledge about the system's dynamics and the way to control. This human capability is suggested to be caused by their exploration strategies for acquiring the adequate policies. The key element of the proposed algorithm is a shaping function defined on a novel position-direction space. The shaping function is autonomously constructed once the goal is reached and constrains the exploration area to optimize the policy. The efficiency of the proposed shaping function was demonstrated by using a nonholonomic control problem of positioning the 2-link planer underactuated manipulator