Zhenjie Shi
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Zhenjie Shi has a total of 8 co-authors. Here are the top co-authors by number of shared publications:
- Gang Xue
Key Laboratory of High-Efficiency and Clean Mechanical Manufacture of Ministry of Education, National Demonstration Center for Experimental Mechanical Engineering Education, School of Mechanical Engineering, Shandong University, Jinan 250061, China
3 shared publications - Yanjun Liu
Key Laboratory of High-Efficiency and Clean Mechanical Manufacture of Ministry of Education, National Demonstration Center for Experimental Mechanical Engineering Education, School of Mechanical Engineering, Shandong University, Jinan 250061, China
3 shared publications - Huaqiang You
School of Mechanical Engineering, State Key Laboratory of Advanced Equipment and Technology for Metal Forming, Key Laboratory of High-Efficiency and Clean Mechanical Manufacture of Ministry of Education, National Demonstration Center for Experimental Mechanical Engineering Education, Shandong University, Jinan 250061, China
2 shared publications - Lei Guo
Institute of Marine Science and Technology, Shandong University, Qingdao, China
1 shared publication - Lin Wang
Institute of Marine Science and Technology, Shandong Key Laboratory of Intelligent Marine Engineering Geology, Environment and Equipment, Shandong University, Qingdao 266237, China
1 shared publication - Song Yin
Key Laboratory of High-Efficiency and Clean Mechanical Manufacture of Ministry of Education, National Demonstration Center for Experimental Mechanical Engineering Education, School of Mechanical Engineering, Shandong University, Jinan 250061, China
1 shared publication
Latest Publications
- Open Access
Adaptive Non-Singular Fast Terminal Sliding Mode Trajectory Tracking Control for Robotic Manipulator with Novel Configuration Based on TD3 Deep Reinforcement Learning and Nonlinear Disturbance Observer
This work proposes a non-singular fast terminal sliding mode control (NFTSMC) strategy based on the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm and a nonlinear disturbance observer (NDO) to address the issues of modeling errors, motion disturbances, and transmission friction in robotic manipulators. Firstly, a novel modular serial 5-DOF robotic manipulator configuration is designed, and its kinematic and dynamic models are established. Secondly, a nonlinear disturbance observer is employed to estimate the total disturbance of the system and apply feedforward compensation. Based on boundary layer technology, an improved NFTSMC method is proposed to accelerate the convergence of tracking errors, reduce chattering, and avoid singularity issues inherent in traditional terminal sliding mode control. The stability of the designed control system is proved using Lyapunov stability theory. Subsequently, a deep reinforcement learning (DRL) agent based on the TD3 algorithm is trained to adaptively adjust the control gains of the non-singular fast terminal sliding mode controller. The dynamic information of the robotic manipulator is used as the input to the TD3 agent, which searches for optimal controller parameters within a continuous action space. A composite reward function is designed to ensure the stable and efficient learning of the TD3 agent. Finally, the motion characteristics of three joints for the designed 5-DOF robotic manipulator are analyzed. The results show that compared to the non-singular fast terminal sliding mode control algorithm based on a nonlinear disturbance observer (NDONFT), the non-singular fast terminal sliding mode control algorithm integrating a nonlinear disturbance observer and the Twin Delayed Deep Deterministic Policy Gradient algorithm (TD3NDONFT) reduces the mean absolute error of position tracking for the three joints by 7.14%, 19.94%, and 6.14%, respectively, and reduces the mean absolute error of velocity tracking by 1.78%, 9.10%, and 2.11%, respectively. These results verify the effectiveness of the proposed algorithm in enhancing the trajectory tracking accuracy of the robotic manipulator under unknown time-varying disturbances and demonstrate its strong robustness against sudden disturbances.
Open AccessAdaptive Non-Singular Fast Terminal Sliding Mode Trajectory Tracking Control for Robotic Manipulator with Novel Configuration Based on TD3 Deep Reinforcement Learning and Nonlinear Disturbance Observer
This work proposes a non-singular fast terminal sliding mode control (NFTSMC) strategy based on the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm and a nonlinear disturbance observer (NDO) to address the issues of modeling errors, motion disturbances, and transmission friction in robotic manipulators. Firstly, a novel modular serial 5-DOF robotic manipulator configuration is designed, and its kinematic and dynamic models are established. Secondly, a nonlinear disturbance observer is employed to estimate the total disturbance of the system and apply feedforward compensation. Based on boundary layer technology, an improved NFTSMC method is proposed to accelerate the convergence of tracking errors, reduce chattering, and avoid singularity issues inherent in traditional terminal sliding mode control. The stability of the designed control system is proved using Lyapunov stability theory. Subsequently, a deep reinforcement learning (DRL) agent based on the TD3 algorithm is trained to adaptively adjust the control gains of the non-singular fast terminal sliding mode controller. The dynamic information of the robotic manipulator is used as the input to the TD3 agent, which searches for optimal controller parameters within a continuous action space. A composite reward function is designed to ensure the stable and efficient learning of the TD3 agent. Finally, the motion characteristics of three joints for the designed 5-DOF robotic manipulator are analyzed. The results show that compared to the non-singular fast terminal sliding mode control algorithm based on a nonlinear disturbance observer (NDONFT), the non-singular fast terminal sliding mode control algorithm integrating a nonlinear disturbance observer and the Twin Delayed Deep Deterministic Policy Gradient algorithm (TD3NDONFT) reduces the mean absolute error of position tracking for the three joints by 7.14%, 19.94%, and 6.14%, respectively, and reduces the mean absolute error of velocity tracking by 1.78%, 9.10%, and 2.11%, respectively. These results verify the effectiveness of the proposed algorithm in enhancing the trajectory tracking accuracy of the robotic manipulator under unknown time-varying disturbances and demonstrate its strong robustness against sudden disturbances.
- Open Access
Adaptive Non-Singular Terminal Sliding Mode Trajectory Tracking Control of Robotic Manipulators Based on Disturbance Observer Under Unknown Time-Varying Disturbance
We address the problems in the trajectory tracking control of a multi-joint robotic arm, including uncertainty in the internal modeling of its significant external unknown time-varying disturbances. With the control objective of tracking the desired trajectories of each joint stably and accurately, this paper proposes an adaptive non-singular terminal sliding mode control method based on a nonlinear disturbance observer (NDO). In order to speed up the convergence of the tracking error and avoid the singular value problem existing in the traditional terminal sliding mode (TSM), a non-singular terminal sliding mode (NTSM) surface is proposed in this paper. Given the system modeling uncertainty and external unknown time-varying disturbances, a nonlinear disturbance observer is used to observe the total set disturbance for feed-forward compensation. Secondly, the switching gain adaptive law is used to estimate the observation error of the total set disturbance and allow for the online adjustment of the switching gain weights. A robust gain adaptive law is also designed to reconverge quickly to the non-singular sliding mode surface when transient significant disturbances shock the system’s state variables out of the sliding phase. A simulation analysis of the spatial two-link robotic arm is carried out in Simulink. The results show that the adaptive non-singular terminal sliding mode control strategy based on the nonlinear disturbance observer proposed (PNDOANTSM) in this paper can reduce the average steady-state errors of robotic arm joints 1 and 2 by 36.58%, 38.40%, 44.68%, and 42.86%, compared with those observed in switching term adaptive law non-singular terminal sliding mode control based on a nonlinear disturbance observer (NDOANTSM) and non-singular terminal sliding mode control based on a nonlinear disturbance observer (NDONTSM). This paper provides a practical and feasible trajectory tracking control method for multi-joint robotic arms.
Open AccessAdaptive Non-Singular Terminal Sliding Mode Trajectory Tracking Control of Robotic Manipulators Based on Disturbance Observer Under Unknown Time-Varying Disturbance
We address the problems in the trajectory tracking control of a multi-joint robotic arm, including uncertainty in the internal modeling of its significant external unknown time-varying disturbances. With the control objective of tracking the desired trajectories of each joint stably and accurately, this paper proposes an adaptive non-singular terminal sliding mode control method based on a nonlinear disturbance observer (NDO). In order to speed up the convergence of the tracking error and avoid the singular value problem existing in the traditional terminal sliding mode (TSM), a non-singular terminal sliding mode (NTSM) surface is proposed in this paper. Given the system modeling uncertainty and external unknown time-varying disturbances, a nonlinear disturbance observer is used to observe the total set disturbance for feed-forward compensation. Secondly, the switching gain adaptive law is used to estimate the observation error of the total set disturbance and allow for the online adjustment of the switching gain weights. A robust gain adaptive law is also designed to reconverge quickly to the non-singular sliding mode surface when transient significant disturbances shock the system’s state variables out of the sliding phase. A simulation analysis of the spatial two-link robotic arm is carried out in Simulink. The results show that the adaptive non-singular terminal sliding mode control strategy based on the nonlinear disturbance observer proposed (PNDOANTSM) in this paper can reduce the average steady-state errors of robotic arm joints 1 and 2 by 36.58%, 38.40%, 44.68%, and 42.86%, compared with those observed in switching term adaptive law non-singular terminal sliding mode control based on a nonlinear disturbance observer (NDOANTSM) and non-singular terminal sliding mode control based on a nonlinear disturbance observer (NDONTSM). This paper provides a practical and feasible trajectory tracking control method for multi-joint robotic arms.
- Open Access
- 11 May 2022
- Published by MDPI AG in Journal of Marine Science and Engineering
- Vol. 10 (5) , 652
Research on Trajectory Tracking Control of Underwater Vehicle Manipulator System Based on Model-Free Adaptive Control Method
In order to improve the trajectory tracking accuracy of an Underwater Vehicle Manipulator System (UVMS) under uncertain disturbance conditions of ocean current, a Model-free Adaptive Control (MFAC) method was used. Combined with Radial Basis Function Neural Networks (RBFNN), the RBFNN-MFAC method is proposed to improve the performance of the controller. A hydrodynamic model of UVMS was defined in the commercial software, Fluent, to calculate hydrodynamics disturbance, and the mechanism of the dynamic model of UVMS was defined in the commercial software, Adams, to simulate the motion of UVMS. The trajectory tracking performance with various control schemes, including PID (Proportional Integral Derivative), MFAC and RBFNN-MFAC, were analyzed with the Adams and Simulink joint simulation model. The results show that the position tracking accuracy and the speed tracking accuracy with the MFAC control scheme were 68.1% and 81.0% better, respectively, than those with PID control scheme. The position tracking accuracy and the speed tracking accuracy with the RBFNN-MFAC control scheme were 66.3% and 43.1% better, respectively, than those with the MFAC control scheme. The MFAC control scheme and the RBFNN-MFAC control scheme proposed in this paper exhibit good trajectory tracking performance without the precise dynamic model of UVMS, which is of great importance to applications in engineering.
- 11 May 2022
- Published by MDPI AG in Journal of Marine Science and Engineering
- Vol. 10 (5) , 652
Open AccessResearch on Trajectory Tracking Control of Underwater Vehicle Manipulator System Based on Model-Free Adaptive Control Method
In order to improve the trajectory tracking accuracy of an Underwater Vehicle Manipulator System (UVMS) under uncertain disturbance conditions of ocean current, a Model-free Adaptive Control (MFAC) method was used. Combined with Radial Basis Function Neural Networks (RBFNN), the RBFNN-MFAC method is proposed to improve the performance of the controller. A hydrodynamic model of UVMS was defined in the commercial software, Fluent, to calculate hydrodynamics disturbance, and the mechanism of the dynamic model of UVMS was defined in the commercial software, Adams, to simulate the motion of UVMS. The trajectory tracking performance with various control schemes, including PID (Proportional Integral Derivative), MFAC and RBFNN-MFAC, were analyzed with the Adams and Simulink joint simulation model. The results show that the position tracking accuracy and the speed tracking accuracy with the MFAC control scheme were 68.1% and 81.0% better, respectively, than those with PID control scheme. The position tracking accuracy and the speed tracking accuracy with the RBFNN-MFAC control scheme were 66.3% and 43.1% better, respectively, than those with the MFAC control scheme. The MFAC control scheme and the RBFNN-MFAC control scheme proposed in this paper exhibit good trajectory tracking performance without the precise dynamic model of UVMS, which is of great importance to applications in engineering.