TGTakakuni Goto

Takakuni Goto

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Takakuni Goto has a total of 6 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • A phased reinforcement learning algorithm for complex control problems

    by Takakuni Goto, Noriyasu Homma, Makoto Yoshizawa, Kenichi Abe


  • Analysis of Human Learning Process on Manual Control of Complex Systems

    by Takakuni Goto, Noriyasu Homma, Makoto Yoshizawa, Kenichi Abe

    In this paper, a novel analysis technique is applied for investigating human operators' trial and error learning process to control a nonholonomic system, 2-link planer underactuated manipulator (2PUAM). An essential core of the technique is to use a value function of the reinforcement learning scheme for revealing how the operators can find a control strategy. It is an advantage of the proposed technique compared to the others that a transition of the value function may explain the changes of the operators' strategies during the learning process. According to the results of the analysis, the operators tended to explore an objective trajectory first, and then shift to the tracking control of the trajectory. The tracking was accompanied with acceleration to achieve the goal faster. Interestingly, the acceleration disturbs the objective trajectory due to the complex dynamics of the target, and induces another exploration to get better trajectories. The fact that this phase transition structure under unsupervised learning environment is consistent with previously reported results for a supervised case implies that the structure can be a general nature of human learning process.


  • Phased Learning with Hierarchical Reinforcement Learning in Nonholonomic Motion Control

    by Takaknuni Goto, Noriyasu Homma, Makoto Yoshizawa, Kenichi Abe

    In this paper, a hierarchical reinforcement learning algorithm for controlling nonholonomic systems is proposed. When applying reinforcement learning to the nonholonomic systems, acquiring adequate policies is difficult because of an increase of learning steps and a convergence of local optimal policies. The proposed algorithm is inspired by such human learning behavior. Human can learn to control such systems sufficiently even if they initially have little knowledge about the system's dynamics and the way to control. This human capability is suggested to be caused by their exploration strategies for acquiring the adequate policies. The key element of the proposed algorithm is a shaping function defined on a novel position-direction space. The shaping function is autonomously constructed once the goal is reached and constrains the exploration area to optimize the policy. The efficiency of the proposed shaping function was demonstrated by using a nonholonomic control problem of positioning the 2-link planer underactuated manipulator