Xuanyang Shi
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Xuanyang Shi has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Junyao Gao
School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
3 shared publications - Yi Liu
Beijing Institute of Astronautical Systems Engineering, Beijing 100076, China
2 shared publications - Chunyu Jiang
Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
1 shared publication - Chuzhao Liu
School of Mechatronical Engineering, Intelligent Robotics Institute, Beijing Institute of Technology, Beijing 100081, China
1 shared publication - Dingkui Tian
Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, 5 Nandajie, Zhongguancun, Haidian, Beijing 100081, China
1 shared publication - Jingchao Zhao
Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
1 shared publication
Latest Publications
- Open Access
A Multitasking-Oriented Robot Arm Motion Planning Scheme Based on Deep Reinforcement Learning and Twin Synchro-Control
Humanoid robots are equipped with humanoid arms to make them more acceptable to the general public. Humanoid robots are a great challenge in robotics. The concept of digital twin technology complies with the guiding ideology of not only Industry 4.0, but also Made in China 2025. This paper proposes a scheme that combines deep reinforcement learning (DRL) with digital twin technology for controlling humanoid robot arms. For rapid and stable motion planning for humanoid robots, multitasking-oriented training using the twin synchro-control (TSC) scheme with DRL is proposed. For switching between tasks, the robot arm training must be quick and diverse. In this work, an approach for obtaining a priori knowledge as input to DRL is developed and verified using simulations. Two simple examples are developed in a simulation environment. We developed a data acquisition system to generate angle data efficiently and automatically. These data are used to improve the reward function of the deep deterministic policy gradient (DDPG) and quickly train the robot for a task. The approach is applied to a model of the humanoid robot BHR-6, a humanoid robot with multiple-motion mode and a sophisticated mechanical structure. Using the policies trained in the simulations, the humanoid robot can perform tasks that are not possible to train with existing methods. The training is fast and allows the robot to perform multiple tasks. Our approach utilizes human joint angle data collected by the data acquisition system to solve the problem of a sparse reward in DRL for two simple tasks. A comparison with simulation results for controllers trained using the vanilla DDPG show that the designed controller developed using the DDPG with the TSC scheme have great advantages in terms of learning stability and convergence speed.
Open AccessA Multitasking-Oriented Robot Arm Motion Planning Scheme Based on Deep Reinforcement Learning and Twin Synchro-Control
Humanoid robots are equipped with humanoid arms to make them more acceptable to the general public. Humanoid robots are a great challenge in robotics. The concept of digital twin technology complies with the guiding ideology of not only Industry 4.0, but also Made in China 2025. This paper proposes a scheme that combines deep reinforcement learning (DRL) with digital twin technology for controlling humanoid robot arms. For rapid and stable motion planning for humanoid robots, multitasking-oriented training using the twin synchro-control (TSC) scheme with DRL is proposed. For switching between tasks, the robot arm training must be quick and diverse. In this work, an approach for obtaining a priori knowledge as input to DRL is developed and verified using simulations. Two simple examples are developed in a simulation environment. We developed a data acquisition system to generate angle data efficiently and automatically. These data are used to improve the reward function of the deep deterministic policy gradient (DDPG) and quickly train the robot for a task. The approach is applied to a model of the humanoid robot BHR-6, a humanoid robot with multiple-motion mode and a sophisticated mechanical structure. Using the policies trained in the simulations, the humanoid robot can perform tasks that are not possible to train with existing methods. The training is fast and allows the robot to perform multiple tasks. Our approach utilizes human joint angle data collected by the data acquisition system to solve the problem of a sparse reward in DRL for two simple tasks. A comparison with simulation results for controllers trained using the vanilla DDPG show that the designed controller developed using the DDPG with the TSC scheme have great advantages in terms of learning stability and convergence speed.
- Open Access
- 23 October 2018
- Published by MDPI AG in Applied Sciences
- Vol. 8 (11) , 2020
Decentralization of Virtual Linkage in Formation Control of Multi-Agents via Consensus Strategies
Featured Application: This paper addresses the formation control of a team of agents based on the decentralized control and the recently introduced reconfigurable virtual linkage approach. Following a decentralized control architecture, a decentralized virtual linkage approach is introduced. As compared to the original virtual linkage approach, the proposed approach uses decentralized architecture rather than hierarchical architecture, which does not require role assignments in each virtual link. In addition, each agent can completely decide its movement with only exchanging states with part of the team members, which makes this approach more suitable for situations when a large number of agents and/or limited communication are involved. Furthermore, the reconfiguration ability is enhanced in this approach by introducing the scale factor of each virtual link. Finally, the effectiveness of the proposed method is demonstrated through simulation results.
- 23 October 2018
- Published by MDPI AG in Applied Sciences
- Vol. 8 (11) , 2020
Open AccessDecentralization of Virtual Linkage in Formation Control of Multi-Agents via Consensus Strategies
Featured Application: This paper addresses the formation control of a team of agents based on the decentralized control and the recently introduced reconfigurable virtual linkage approach. Following a decentralized control architecture, a decentralized virtual linkage approach is introduced. As compared to the original virtual linkage approach, the proposed approach uses decentralized architecture rather than hierarchical architecture, which does not require role assignments in each virtual link. In addition, each agent can completely decide its movement with only exchanging states with part of the team members, which makes this approach more suitable for situations when a large number of agents and/or limited communication are involved. Furthermore, the reconfiguration ability is enhanced in this approach by introducing the scale factor of each virtual link. Finally, the effectiveness of the proposed method is demonstrated through simulation results.
- Open Access
A New Disaster Information Sensing Mode: Using Multi-Robot System with Air Dispersal Mode
This paper presents a novel sensing mode for using mobile robots to collect disaster ground information when the ground traffic from the rescue center to disaster site is disrupted. Traditional sensing modes which use aerial robots or ground robots independently either have limited ability to access disaster site or are only able to provide a bird’s eye view of the disaster site. To illustrate the proposed sensing mode, the authors have developed a Multi-robot System with Air Dispersal Mode (MSADM) by combining the unimpeded path of aerial robots with the detailed view of ground robots. In the MSADM, an airplane carries some minimal reconnaissance ground robots to overcome the paralyzed traffic problem and deploys them on the ground to collect detailed scene information using parachutes and separation device modules. In addition, the airplane cruises in the sky and relays the control and reported information between the ground robots and the human operator. This means that the proposed sensing mode is able to provide more reliable communication performance when there are obstacles between the human operators and the ground robots. Additionally, the proposed sensing mode can easily make use of different kinds of ground robots, as long as they have a compatible interface with the separation device. Finally, an experimental demonstration of the MSADM is presented to show the effectiveness of the proposed sensing mode.
Open AccessA New Disaster Information Sensing Mode: Using Multi-Robot System with Air Dispersal Mode
This paper presents a novel sensing mode for using mobile robots to collect disaster ground information when the ground traffic from the rescue center to disaster site is disrupted. Traditional sensing modes which use aerial robots or ground robots independently either have limited ability to access disaster site or are only able to provide a bird’s eye view of the disaster site. To illustrate the proposed sensing mode, the authors have developed a Multi-robot System with Air Dispersal Mode (MSADM) by combining the unimpeded path of aerial robots with the detailed view of ground robots. In the MSADM, an airplane carries some minimal reconnaissance ground robots to overcome the paralyzed traffic problem and deploys them on the ground to collect detailed scene information using parachutes and separation device modules. In addition, the airplane cruises in the sky and relays the control and reported information between the ground robots and the human operator. This means that the proposed sensing mode is able to provide more reliable communication performance when there are obstacles between the human operators and the ground robots. Additionally, the proposed sensing mode can easily make use of different kinds of ground robots, as long as they have a compatible interface with the separation device. Finally, an experimental demonstration of the MSADM is presented to show the effectiveness of the proposed sensing mode.