He Yin
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
He Yin has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
- Shuxiang Guo
Department of Electronic and Electrical Engineering, Southern University of Science and Technology, Shenzhen, China
4 shared publications - Liwei Shi
School of Medical Technology, Beijing Institute of Technology, Beijing, China
3 shared publications - Huiming Xing
College of Intelligent Systems Science and Engineering, Harbin Engineering University, Harbin 150001, China
2 shared publications - Xihuan Hou
School of Intelligence and Information Engineer, Tangshan University, Tangshan 063000, China
2 shared publications - Zan Li
Cai Hong Unmanned Aerial Vehicle Co., Ltd., China Academy of Aerospace Aerodynamics, Beijing 100074, China
2 shared publications Ao Li
Beijing Institute of Technology, Beijing, China
1 shared publication
Latest Publications
- 23 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 24 (1) , 769-779
A Deep Reinforcement Learning-Based Decentralized Hierarchical Motion Control Strategy for Multiple Amphibious Spherical Robot Systems With Tilting Thrusters
The variable operating conditions and hostile environments faced by underwater robots remains a challenge for motion control in unknown environments. In order to improve the capability of the amphibious spherical robot (ASR) in the unknown environments, a decentralized hierarchical deep reinforcement learning (DRL) motion control method based on deep deterministic policy gradient (DDPG) for multiple amphibious spherical robots system is proposed. In the low-level, a DDPG-based motion controller is trained under a compound rewarding to learn to set the configurations of the tilting angle and rotational speed of each thruster at a proper timescale. In the high-level, a planning controller consisting of different action networks is designed to generate a reasonable thrust target to guide the movement of the robot. Specifically, inspired by the artificial potential field method, the complex underwater motion can be decomposed into several simple virtual forces. Each action network is trained to learn to generate a virtual thrust target component for a specific action. By combining the outputs of several action networks, the distributed cooperative motion control for multi-robot systems can then be easily achieved. Finally, the motion control strategy is applied to the physical multi-ASR system, and the experiment results have shown satisfactory performance.
- 23 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 24 (1) , 769-779
A Deep Reinforcement Learning-Based Decentralized Hierarchical Motion Control Strategy for Multiple Amphibious Spherical Robot Systems With Tilting Thrusters
The variable operating conditions and hostile environments faced by underwater robots remains a challenge for motion control in unknown environments. In order to improve the capability of the amphibious spherical robot (ASR) in the unknown environments, a decentralized hierarchical deep reinforcement learning (DRL) motion control method based on deep deterministic policy gradient (DDPG) for multiple amphibious spherical robots system is proposed. In the low-level, a DDPG-based motion controller is trained under a compound rewarding to learn to set the configurations of the tilting angle and rotational speed of each thruster at a proper timescale. In the high-level, a planning controller consisting of different action networks is designed to generate a reasonable thrust target to guide the movement of the robot. Specifically, inspired by the artificial potential field method, the complex underwater motion can be decomposed into several simple virtual forces. Each action network is trained to learn to generate a virtual thrust target component for a specific action. By combining the outputs of several action networks, the distributed cooperative motion control for multi-robot systems can then be easily achieved. Finally, the motion control strategy is applied to the physical multi-ASR system, and the experiment results have shown satisfactory performance.
- Open Access
Hydrodynamic Characteristic-Based Adaptive Model Predictive Control for the Spherical Underwater Robot under Ocean Current Disturbance
In the navigation of underwater robots, large ocean current disturbance often causes significant tracking errors. To better resist ocean current disturbance, the hydrodynamic characteristics of the spherical underwater robot are studied, and a model predictive control strategy based on adaptive model parameters is proposed, according to these characteristics. Firstly, the hydrodynamic characteristics of the robot under static water and constant flow disturbance were obtained and analyzed by the computational fluid dynamics method. Then, the dynamic models of the robot under different disturbances could be calculated from the data obtained, based on the least square method. Finally, an adaptive model predictive control (AMPC) strategy, with an ocean current observer, was designed, based on the dynamic models. When the current disturbance velocity was twice the robot velocity, the proposed strategy reduced the tracking error by 39% and 42% in X and Y directions, respectively. In addition, the hydrodynamic characteristics were verified by experiments.
Open AccessHydrodynamic Characteristic-Based Adaptive Model Predictive Control for the Spherical Underwater Robot under Ocean Current Disturbance
In the navigation of underwater robots, large ocean current disturbance often causes significant tracking errors. To better resist ocean current disturbance, the hydrodynamic characteristics of the spherical underwater robot are studied, and a model predictive control strategy based on adaptive model parameters is proposed, according to these characteristics. Firstly, the hydrodynamic characteristics of the robot under static water and constant flow disturbance were obtained and analyzed by the computational fluid dynamics method. Then, the dynamic models of the robot under different disturbances could be calculated from the data obtained, based on the least square method. Finally, an adaptive model predictive control (AMPC) strategy, with an ocean current observer, was designed, based on the dynamic models. When the current disturbance velocity was twice the robot velocity, the proposed strategy reduced the tracking error by 39% and 42% in X and Y directions, respectively. In addition, the hydrodynamic characteristics were verified by experiments.
- Open Access
An Improved Backstepping Controller with an LESO and TDs for Robust Underwater 3D Trajectory Tracking of a Turtle-Inspired Amphibious Spherical Robot
In this paper, a double closed-loop backstepping controller is designed for 3D trajectory tracking of a turtle-inspired amphibious spherical robot suffering from problems that include model uncertainties, environmental disturbances, and unmeasured velocity. The proposed controller scheme tackles three primary challenges: the differentiation explosion of the traditional backstepping method, unmeasured velocity, and the consideration of lumped disturbances. Beginning with an outer-loop backstepping controller, a virtual feedback variable is constructed to simplify the design of the backstepping controller. Meanwhile, to avoid the problem of differentiation explosion, tracking differentiators (TDs) are utilized to estimate the differentiation of the desired velocity in an inner-loop backstepping controller. Moreover, there are some uncertainty disturbances in the task of tracking the trajectory of a turtle-inspired amphibious spherical robot (TASR), such as the parameters of the hydrodynamic model and environmental disturbances. A linear extended state observer (LESO) is designed to estimate and compensate for the lumped disturbances. Furthermore, as the velocity states of the TASR are unmeasured, the LESO is also utilized to estimate the velocity states in surge, yaw, and heave degrees. Therefore, the TASR only needs to supply its position and orientation information for the trajectory tracking task. Note that this paper details both the design process of the proposed controller and a rigorous theoretical analysis. In addition, numerical simulations are conducted, and the results demonstrate the feasibility and superiority of the proposed method.
Open AccessAn Improved Backstepping Controller with an LESO and TDs for Robust Underwater 3D Trajectory Tracking of a Turtle-Inspired Amphibious Spherical Robot
In this paper, a double closed-loop backstepping controller is designed for 3D trajectory tracking of a turtle-inspired amphibious spherical robot suffering from problems that include model uncertainties, environmental disturbances, and unmeasured velocity. The proposed controller scheme tackles three primary challenges: the differentiation explosion of the traditional backstepping method, unmeasured velocity, and the consideration of lumped disturbances. Beginning with an outer-loop backstepping controller, a virtual feedback variable is constructed to simplify the design of the backstepping controller. Meanwhile, to avoid the problem of differentiation explosion, tracking differentiators (TDs) are utilized to estimate the differentiation of the desired velocity in an inner-loop backstepping controller. Moreover, there are some uncertainty disturbances in the task of tracking the trajectory of a turtle-inspired amphibious spherical robot (TASR), such as the parameters of the hydrodynamic model and environmental disturbances. A linear extended state observer (LESO) is designed to estimate and compensate for the lumped disturbances. Furthermore, as the velocity states of the TASR are unmeasured, the LESO is also utilized to estimate the velocity states in surge, yaw, and heave degrees. Therefore, the TASR only needs to supply its position and orientation information for the trajectory tracking task. Note that this paper details both the design process of the proposed controller and a rigorous theoretical analysis. In addition, numerical simulations are conducted, and the results demonstrate the feasibility and superiority of the proposed method.
- Open Access
- 16 November 2020
- Published by MDPI AG in Applied Sciences
- Vol. 10 (22) , 8106
Improved Model Predictive-Based Underwater Trajectory Tracking Control for the Biomimetic Spherical Robot under Constraints
To improve the autonomy of the biomimetic sphere robot (BSR), an underwater trajectory tracking problem was studied. Considering the thrusters saturation of the BSR, an improved model predictive control (MPC) algorithm that features processing multiple constraints was designed. With the proposed algorithm, the kinematic and dynamic models of the BSR are combined in order to establish the predictive model, and a new state-space model is designed that is based on an increment of the control input. Furthermore, to avoid the infeasibility of the cost function in the MPC controller design, a new term with a slack variable is added to the objective function, which enables the constraints to be imposed as soft constraints. The simulation results illustrate that the BSR was able to track the desired trajectory accurately and stably while using the improved MPC algorithm. Furthermore, a comparison with the traditional MPC shows that the designed MPC-based increment of the control input is small. In addition, a comparative simulation using the backstepping method verifies the effectiveness of the proposed method. Unlike previous studies that only focused on the simulation validations, in this study a series of experiments were carried out that further demonstrate the effectiveness of the improved MPC for underwater trajectory tracking of the BSR. The experimental results illustrate that the improved MPC is able to drive the BSR to quickly track the reference trajectory. When compared with a traditional MPC and the backstepping method used in the experiment, the proposed MPC-based trajectory is closer to the reference trajectory.
- 16 November 2020
- Published by MDPI AG in Applied Sciences
- Vol. 10 (22) , 8106
Open AccessImproved Model Predictive-Based Underwater Trajectory Tracking Control for the Biomimetic Spherical Robot under Constraints
To improve the autonomy of the biomimetic sphere robot (BSR), an underwater trajectory tracking problem was studied. Considering the thrusters saturation of the BSR, an improved model predictive control (MPC) algorithm that features processing multiple constraints was designed. With the proposed algorithm, the kinematic and dynamic models of the BSR are combined in order to establish the predictive model, and a new state-space model is designed that is based on an increment of the control input. Furthermore, to avoid the infeasibility of the cost function in the MPC controller design, a new term with a slack variable is added to the objective function, which enables the constraints to be imposed as soft constraints. The simulation results illustrate that the BSR was able to track the desired trajectory accurately and stably while using the improved MPC algorithm. Furthermore, a comparison with the traditional MPC shows that the designed MPC-based increment of the control input is small. In addition, a comparative simulation using the backstepping method verifies the effectiveness of the proposed method. Unlike previous studies that only focused on the simulation validations, in this study a series of experiments were carried out that further demonstrate the effectiveness of the improved MPC for underwater trajectory tracking of the BSR. The experimental results illustrate that the improved MPC is able to drive the BSR to quickly track the reference trajectory. When compared with a traditional MPC and the backstepping method used in the experiment, the proposed MPC-based trajectory is closer to the reference trajectory.
- 1 December 2006
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Journal of Systems Engineering and Electronics
- Vol. 17 (4) , 896-900
Decision feedback equalizer based on non-singleton fuzzy regular neural networks
A new equalization method is proposed in this paper for severely nonlinear distorted channels. The structure of decision feedback is adopted for the non-singleton fuzzy regular neural network that is trained by gradient-descent algorithm. The model s...
- 1 December 2006
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Journal of Systems Engineering and Electronics
- Vol. 17 (4) , 896-900
Decision feedback equalizer based on non-singleton fuzzy regular neural networks
A new equalization method is proposed in this paper for severely nonlinear distorted channels. The structure of decision feedback is adopted for the non-singleton fuzzy regular neural network that is trained by gradient-descent algorithm. The model s...