Zhaoyang Qi
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Zhaoyang Qi has a total of 20 co-authors. Here are the top co-authors by number of shared publications:
- Li Zhang
Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong SAR, China
6 shared publications - Mingxue Cai
Guangdong Provincial Key Laboratory of Robotics and Intelligent System, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
5 shared publications - Yanfei Cao
Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
5 shared publications - Tiantian Xu
Guangdong Provincial Key Laboratory of Robotics and Intelligent System, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, P. R. China
3 shared publications - Xinyu Wu
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences
3 shared publications - Xurui Liu
School of Integrated Circuits and Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
3 shared publications
Latest Publications
- 23 September 2026
- Published by American Association for the Advancement of Science (AAAS) in Science Robotics
- Vol. 11 (118)
AI-driven actuation-compatible tracking for closed-loop navigation of miniature robots in vivo
Miniature wireless magnetic robots (MWMRs) hold immense potential for minimally invasive interventions. Real-time tracking of MWMRs is essential for precise in vivo navigation but remains challenging. Tracking MWMRs via their emitted magnetic signals offers a viable solution, yet it has been limited to centimeter-scale robots because isolating weak MWMR signals from overwhelming actuation-induced interference becomes increasingly difficult with miniaturization. Here, we present an artificial intelligence (AI)–driven tracking system to overcome these challenges, enabling precise localization of millimeter-scale MWMRs in the presence of actuation fields. Our approach integrates a sensor array design with a transformer to accurately model and filter the interference, followed by a spatiotemporal transformer that interprets the extracted MWMR signals over a short time window to corresponding three-dimensional coordinates. Our system has been validated in a range of in vitro and in vivo experiments, demonstrating its applicability to closed-loop navigation of MWMRs in unshielded clinical settings.
- 23 September 2026
- Published by American Association for the Advancement of Science (AAAS) in Science Robotics
- Vol. 11 (118)
AI-driven actuation-compatible tracking for closed-loop navigation of miniature robots in vivo
Miniature wireless magnetic robots (MWMRs) hold immense potential for minimally invasive interventions. Real-time tracking of MWMRs is essential for precise in vivo navigation but remains challenging. Tracking MWMRs via their emitted magnetic signals offers a viable solution, yet it has been limited to centimeter-scale robots because isolating weak MWMR signals from overwhelming actuation-induced interference becomes increasingly difficult with miniaturization. Here, we present an artificial intelligence (AI)–driven tracking system to overcome these challenges, enabling precise localization of millimeter-scale MWMRs in the presence of actuation fields. Our approach integrates a sensor array design with a transformer to accurately model and filter the interference, followed by a spatiotemporal transformer that interprets the extracted MWMR signals over a short time window to corresponding three-dimensional coordinates. Our system has been validated in a range of in vitro and in vivo experiments, demonstrating its applicability to closed-loop navigation of MWMRs in unshielded clinical settings.
- Open Access
- 6 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 41 (15523098) , 1513-1532
Magnetic Continuum Robot With Modular Axial Magnetization: Design, Modeling, Optimization, and Control
Magnetic continuum robots (MCRs) have become popular owing to their inherent advantages of easy miniaturization without requiring complicated transmission structures. The evolution of MCRs, from initial designs with one embedded magnet to current designs with specific magnetization profile configurations (MPCs), has significantly enhanced their dexterity. While much progress has been achieved, the quantitative index-based evaluation of deformability for different MPCs, which can assist in designing MPCs with enhanced robot deformability, has not been addressed before. Here we use “deformability” to describe the capability for body deflection when an MCR forms different global shapes under an external magnetic field. Therefore, in this paper, we propose methodologies to design and control an MCR composed of modular axially magnetized segments. To guide robot MPC design, for the first time, we introduce a quantitative index-based evaluation strategy to analyze and optimize robot deformability. Additionally, a control framework with neural network-based controllers is developed to endow the robot with two control modes: the robot tip position and orientation ( $M_{1}$ ) and the global shape ( $M_{2}$ ). The excellent performance of the learnt controllers in terms of computation time and accuracy was validated via both simulation and experimental platforms. In the experimental results, the best closed-loop control performance metrics, indicated as the mean absolute errors, were 0.254 mm and 0.626 $^\circ$ for mode $M_{1}$ and 1.564 mm and 0.086 $^\circ$ for mode $M_{2}$ .
- 6 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 41 (15523098) , 1513-1532
Open AccessMagnetic Continuum Robot With Modular Axial Magnetization: Design, Modeling, Optimization, and Control
Magnetic continuum robots (MCRs) have become popular owing to their inherent advantages of easy miniaturization without requiring complicated transmission structures. The evolution of MCRs, from initial designs with one embedded magnet to current designs with specific magnetization profile configurations (MPCs), has significantly enhanced their dexterity. While much progress has been achieved, the quantitative index-based evaluation of deformability for different MPCs, which can assist in designing MPCs with enhanced robot deformability, has not been addressed before. Here we use “deformability” to describe the capability for body deflection when an MCR forms different global shapes under an external magnetic field. Therefore, in this paper, we propose methodologies to design and control an MCR composed of modular axially magnetized segments. To guide robot MPC design, for the first time, we introduce a quantitative index-based evaluation strategy to analyze and optimize robot deformability. Additionally, a control framework with neural network-based controllers is developed to endow the robot with two control modes: the robot tip position and orientation ( $M_{1}$ ) and the global shape ( $M_{2}$ ). The excellent performance of the learnt controllers in terms of computation time and accuracy was validated via both simulation and experimental platforms. In the experimental results, the best closed-loop control performance metrics, indicated as the mean absolute errors, were 0.254 mm and 0.626 $^\circ$ for mode $M_{1}$ and 1.564 mm and 0.086 $^\circ$ for mode $M_{2}$ .
- 3 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 40 (15523098) , 4117-4131
Performance-Guided Rotating Magnetic Field Control in Large Workspaces With Reconfigurable Electromagnetic Actuation System
Remote-actuated magnetic robots, relying solely on the magnetic torque stemming from rotating magnetic fields, hold immense promise in biomedical applications. However, to precisely actuate magnetic robots in large workspaces, the efficient generation of isotropic rotating fields using electromagnetic actuation (EMA) systems presents an enduring challenge. This is because the choice of configuration of the EMA system is a major concern, particularly when considering collision avoidance between coils and the human body while ensuring isotropic actuation. In this study, we presented an analysis of the characteristics of various three-coil configurations by quantitatively evaluating field isotropy. Furthermore, we introduced a performance-guided optimization method to adjust coil configurations by optimizing designed evaluation metrics, aiming to generate rotating fields with isotropic characteristics in a target local region. Finally, we implemented a reconfigurable electromagnetic actuation system (REMA) and conducted extensive experiments to demonstrate the capability of our method and platform. The experimental results showcase the potential of our approach for advanced clinical applications.
- 3 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 40 (15523098) , 4117-4131
Performance-Guided Rotating Magnetic Field Control in Large Workspaces With Reconfigurable Electromagnetic Actuation System
Remote-actuated magnetic robots, relying solely on the magnetic torque stemming from rotating magnetic fields, hold immense promise in biomedical applications. However, to precisely actuate magnetic robots in large workspaces, the efficient generation of isotropic rotating fields using electromagnetic actuation (EMA) systems presents an enduring challenge. This is because the choice of configuration of the EMA system is a major concern, particularly when considering collision avoidance between coils and the human body while ensuring isotropic actuation. In this study, we presented an analysis of the characteristics of various three-coil configurations by quantitatively evaluating field isotropy. Furthermore, we introduced a performance-guided optimization method to adjust coil configurations by optimizing designed evaluation metrics, aiming to generate rotating fields with isotropic characteristics in a target local region. Finally, we implemented a reconfigurable electromagnetic actuation system (REMA) and conducted extensive experiments to demonstrate the capability of our method and platform. The experimental results showcase the potential of our approach for advanced clinical applications.
- Open Access
- 29 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 54 (12) , 7629-7641
Robust 3-D Path Following Control Framework for Magnetic Helical Millirobots Subject to Fluid Flow and Input Saturation
Precise trajectory control is imperative to ensure the safety and efficacy of in vivo therapy employing the magnetic helical millirobots. However, achieving accurate 3-D path following of helical millirobots under fluid flow conditions remains challenging due to the presence of the lumped disturbances, encompassing complex fluid dynamics and input frequency saturation. This study proposes a robust 3-D path following control framework that combines a disturbance observer for perturbation estimation with an adaptive finite-time sliding mode controller for autonomous navigation along the reference trajectories. First, a magnetic helical millirobot’s kinematic model based on the 3-D hand position approach is established. Subsequently, a robust smooth differentiator is implemented as an observer to estimate disturbances within a finite time. We then investigate an adaptive finite-time sliding mode controller incorporating an auxiliary system to mitigate the estimated disturbance and achieve precise 3-D path tracking while respecting the input constraints. The adaptive mechanism of this controller ensures fast convergence of the system while alleviating the chattering effects. Finally, we provide a rigorous theoretical analysis of the finite-time stability of the closed-loop system based on the Lyapunov functions. Utilizing a robotically-actuated magnetic manipulation system, experimental results demonstrate the efficacy of the proposed approach in terms of the control accuracy and convergence time.
- 29 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 54 (12) , 7629-7641
Open AccessRobust 3-D Path Following Control Framework for Magnetic Helical Millirobots Subject to Fluid Flow and Input Saturation
Precise trajectory control is imperative to ensure the safety and efficacy of in vivo therapy employing the magnetic helical millirobots. However, achieving accurate 3-D path following of helical millirobots under fluid flow conditions remains challenging due to the presence of the lumped disturbances, encompassing complex fluid dynamics and input frequency saturation. This study proposes a robust 3-D path following control framework that combines a disturbance observer for perturbation estimation with an adaptive finite-time sliding mode controller for autonomous navigation along the reference trajectories. First, a magnetic helical millirobot’s kinematic model based on the 3-D hand position approach is established. Subsequently, a robust smooth differentiator is implemented as an observer to estimate disturbances within a finite time. We then investigate an adaptive finite-time sliding mode controller incorporating an auxiliary system to mitigate the estimated disturbance and achieve precise 3-D path tracking while respecting the input constraints. The adaptive mechanism of this controller ensures fast convergence of the system while alleviating the chattering effects. Finally, we provide a rigorous theoretical analysis of the finite-time stability of the closed-loop system based on the Lyapunov functions. Utilizing a robotically-actuated magnetic manipulation system, experimental results demonstrate the efficacy of the proposed approach in terms of the control accuracy and convergence time.
- 5 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 5982-5993
Development of Reconfigurable Electromagnetic Actuation System With Large Workspaces: Design, Optimization, and Validation
Magnetically actuated robots have recently shown great capabilities for remote applications in medical procedures. However, the efficient actuation of magnetic robots with dexterous field and gradient generation in large workspaces remains challenging. To overcome the critical challenges, we report a reconfigurable electromagnetic actuation system (REMA) for regulating magnetic fields (maximum: 17 mT) and gradients (maximum: 120 mT/m) in large workspaces. Reconfigurable coil configurations are achieved by employing three mobile electromagnetic coils mounted on three independent 6-DOF robotic arms. Furthermore, the field characteristics generated by a single coil and three coils were modeled via Finite-element method (FEM) and measurements from experiments, respectively. Since there are non-linearities between desired field generation and coil configuration, we propose a multi-objective optimization (MOO) method for generating the Pareto-optimized coil configuration to achieve field and force control in large workspaces. Finally, extensive experiments were conducted to demonstrate the capability and dexterity of our system for autonomous magnetic manipulation in large workspaces, thus showing its potential for clinical applications. Note to Practitioners —This paper aims to address the dexterous generation of magnetic fields and gradients in large workspaces, aiming to realize accurate, efficient, and automated control of different magnetic robots. This paper introduces a reconfigurable electromagnetic actuation system based on three independent robotic arms with three electromagnetic coils. Subsequently, we propose a multi-objective optimization (MOO) method to regulate the coil configuration for generating different fields and gradients. This approach facilitates the application of magnetically driven helical robots, catheters, and capsule robots in various medical scenarios. The results demonstrate that our proposed platform and optimization strategy can effectively implement magnetic manipulations across diverse application scenarios. Looking ahead, we anticipate integrating our work with medical imaging devices to furnish doctors with enhanced tools for medical applications.
- 5 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 5982-5993
Development of Reconfigurable Electromagnetic Actuation System With Large Workspaces: Design, Optimization, and Validation
Magnetically actuated robots have recently shown great capabilities for remote applications in medical procedures. However, the efficient actuation of magnetic robots with dexterous field and gradient generation in large workspaces remains challenging. To overcome the critical challenges, we report a reconfigurable electromagnetic actuation system (REMA) for regulating magnetic fields (maximum: 17 mT) and gradients (maximum: 120 mT/m) in large workspaces. Reconfigurable coil configurations are achieved by employing three mobile electromagnetic coils mounted on three independent 6-DOF robotic arms. Furthermore, the field characteristics generated by a single coil and three coils were modeled via Finite-element method (FEM) and measurements from experiments, respectively. Since there are non-linearities between desired field generation and coil configuration, we propose a multi-objective optimization (MOO) method for generating the Pareto-optimized coil configuration to achieve field and force control in large workspaces. Finally, extensive experiments were conducted to demonstrate the capability and dexterity of our system for autonomous magnetic manipulation in large workspaces, thus showing its potential for clinical applications. Note to Practitioners —This paper aims to address the dexterous generation of magnetic fields and gradients in large workspaces, aiming to realize accurate, efficient, and automated control of different magnetic robots. This paper introduces a reconfigurable electromagnetic actuation system based on three independent robotic arms with three electromagnetic coils. Subsequently, we propose a multi-objective optimization (MOO) method to regulate the coil configuration for generating different fields and gradients. This approach facilitates the application of magnetically driven helical robots, catheters, and capsule robots in various medical scenarios. The results demonstrate that our proposed platform and optimization strategy can effectively implement magnetic manipulations across diverse application scenarios. Looking ahead, we anticipate integrating our work with medical imaging devices to furnish doctors with enhanced tools for medical applications.
- Open Access
- 25 July 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 72 (2) , 1732-1742
Magnetic Field-Priority Force Control for Automated Manipulation in Large Workspaces With Reconfigurable Electromagnetic Actuation System
Rapid technological advancements in remote-controlled magnetic robots that operate inside the human body have strongly stimulated the development of magnetic actuation systems owing to their ability to produce demanding magnetic fields and forces. However, the efficient generation of the combined field and force in large workspaces still needs to be improved. To resolve this critical challenge, we first investigated the required number of mobile magnetic sources for a magnetic actuation system to regulate field and force in large workspaces. Subsequently, we demonstrated that a three-electromagnetic-coil configuration can effectively produce the desired field and force. This is achieved through the implementation of a field-priority force control method utilizing three robotic arms. Notably, this method considers Yoshikawa manipulability for each robotic arm, which matters for manipulating magnetic robots in large workspaces. Specifically, we evaluated the force error by sampling 50 different field-force combinations from the workspace. Finally, a reconfigurable electromagnetic actuation system (REMA) was developed by mounting three mobile electromagnetic coils mounted on three independent robotic arms. The effectiveness of the proposed method and platform was demonstrated by actuating a capsule robot in both 2-D and 3-D application scenarios.
- 25 July 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 72 (2) , 1732-1742
Open AccessMagnetic Field-Priority Force Control for Automated Manipulation in Large Workspaces With Reconfigurable Electromagnetic Actuation System
Rapid technological advancements in remote-controlled magnetic robots that operate inside the human body have strongly stimulated the development of magnetic actuation systems owing to their ability to produce demanding magnetic fields and forces. However, the efficient generation of the combined field and force in large workspaces still needs to be improved. To resolve this critical challenge, we first investigated the required number of mobile magnetic sources for a magnetic actuation system to regulate field and force in large workspaces. Subsequently, we demonstrated that a three-electromagnetic-coil configuration can effectively produce the desired field and force. This is achieved through the implementation of a field-priority force control method utilizing three robotic arms. Notably, this method considers Yoshikawa manipulability for each robotic arm, which matters for manipulating magnetic robots in large workspaces. Specifically, we evaluated the force error by sampling 50 different field-force combinations from the workspace. Finally, a reconfigurable electromagnetic actuation system (REMA) was developed by mounting three mobile electromagnetic coils mounted on three independent robotic arms. The effectiveness of the proposed method and platform was demonstrated by actuating a capsule robot in both 2-D and 3-D application scenarios.