Kaiyan Yu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Kaiyan Yu has a total of 24 co-authors. Here are the top co-authors by number of shared publications:
- Jingang Yi
Department of Mechanical and Aerospace Engineering, Rutgers University, Piscataway, USA
7 shared publications - Juan Wu
Department of Mechanical Engineering, Binghamton University, Binghamton, NY, USA
3 shared publications Jerry W. Shan
Rutgers University
2 shared publicationsJiaxu Song
Department of Mechanical Engineering, Binghamton University, Binghamton, NY, USA
2 shared publicationsJuan Wu
Department of Mechanical Engineering, Binghamton University, Binghamton, NY, USA
2 shared publicationsShiming Fang
SUNY Polytechnic Institute
2 shared publications
Latest Publications
- 1 November 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control Systems Technology
- Vol. 34 (6) , 2953-2968
DRCC-LPVMPC: Robust Data-Driven Control for Autonomous Driving and Obstacle Avoidance
- 1 November 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control Systems Technology
- Vol. 34 (6) , 2953-2968
DRCC-LPVMPC: Robust Data-Driven Control for Autonomous Driving and Obstacle Avoidance
- Open Access
Optimal Planning for Multi-Robot Simultaneous Area and Line Coverage Using Hierarchical Cyclic Merging Regulation
The double coverage problem focuses on determining efficient, collision-free routes for multiple robots to simultaneously cover linear features (e.g., surface cracks or road routes) and survey areas (e.g., parking lots or local regions) in known environments. In these problems, each robot carries two functional roles: service (linear feature footprint coverage) and exploration (complete area coverage). Service has a smaller operational footprint but incurs higher costs (e.g., time) compared to exploration. We present optimal planning algorithms for the double coverage problems using hierarchical cyclic merging regulation (HCMR). To reduce the complexity for optimal planning solutions, we analyze the manifold attachment process during graph traversal from a Morse theory perspective. We show that solutions satisfying minimum path length and collision-free constraints must belong to a Morse-bounded collection. To identify this collection, we introduce the HCMR algorithm. In HCMR, cyclic merging search regulates traversal behavior, while edge sequence back propagation converts these regulations into graph edge traversal sequences. Incorporating balanced partitioning, the optimal sequence is selected to generate routes for each robot. We prove the optimality of the HCMR algorithm under a fixed sweep direction. The multi-robot simulation results demonstrate that the HCMR algorithm significantly improves planned path length by at least 10.0%, reduces task time by at least 16.9% in average, and ensures conflict-free operation compared to other state-of-the-art planning methods.
Open AccessOptimal Planning for Multi-Robot Simultaneous Area and Line Coverage Using Hierarchical Cyclic Merging Regulation
The double coverage problem focuses on determining efficient, collision-free routes for multiple robots to simultaneously cover linear features (e.g., surface cracks or road routes) and survey areas (e.g., parking lots or local regions) in known environments. In these problems, each robot carries two functional roles: service (linear feature footprint coverage) and exploration (complete area coverage). Service has a smaller operational footprint but incurs higher costs (e.g., time) compared to exploration. We present optimal planning algorithms for the double coverage problems using hierarchical cyclic merging regulation (HCMR). To reduce the complexity for optimal planning solutions, we analyze the manifold attachment process during graph traversal from a Morse theory perspective. We show that solutions satisfying minimum path length and collision-free constraints must belong to a Morse-bounded collection. To identify this collection, we introduce the HCMR algorithm. In HCMR, cyclic merging search regulates traversal behavior, while edge sequence back propagation converts these regulations into graph edge traversal sequences. Incorporating balanced partitioning, the optimal sequence is selected to generate routes for each robot. We prove the optimality of the HCMR algorithm under a fixed sweep direction. The multi-robot simulation results demonstrate that the HCMR algorithm significantly improves planned path length by at least 10.0%, reduces task time by at least 16.9% in average, and ensures conflict-free operation compared to other state-of-the-art planning methods.
- Open Access
- 25 April 2025
- Published by Springer Nature in International Journal of Intelligent Robotics and Applications
- Vol. 9 (4) , 1594-1610
Fine-tuning hybrid dynamics with physics-informed neural networks for vehicle dynamics estimation
Accurate dynamic modeling is critical for autonomous racing vehicles, especially during high-speed and agile maneuvers where precise motion prediction is essential for safety. Traditional parameter estimation methods face limitations such as reliance on initial guesses, labor-intensive fitting procedures, and complex testing setups. On the other hand, purely data-driven machine learning methods struggle to capture inherent physical constraints and typically require large datasets for optimal performance. To address these challenges, this paper introduces the Fine-Tuning Hybrid Dynamics (FTHD) method, which integrates supervised and unsupervised Physics-Informed Neural Networks, combining physics-based modeling with data-driven techniques. FTHD fine-tunes a pre-trained Deep Dynamics Model (DDM) using a smaller training dataset, delivering superior performance compared to state-of-the-art methods such as the Deep Pacejka Model and outperforming the original DDM. Furthermore, an Extended Kalman Filter (EKF) is embedded within FTHD (EKF-FTHD) to effectively manage noisy real-world data, ensuring accurate denoising while preserving the vehicle’s essential physical characteristics. The proposed FTHD framework is validated through scaled simulations using the BayesRace Physics-based Simulator and full-scale real-world experiments from the Indy Autonomous Challenge. Results demonstrate that the hybrid approach significantly improves parameter estimation accuracy, even with reduced data, and outperforms existing models. EKF-FTHD enhances robustness by denoising real-world data while maintaining physical insights, representing a notable advancement in vehicle dynamics modeling for high-speed autonomous racing.
- 25 April 2025
- Published by Springer Nature in International Journal of Intelligent Robotics and Applications
- Vol. 9 (4) , 1594-1610
Open AccessFine-tuning hybrid dynamics with physics-informed neural networks for vehicle dynamics estimation
Accurate dynamic modeling is critical for autonomous racing vehicles, especially during high-speed and agile maneuvers where precise motion prediction is essential for safety. Traditional parameter estimation methods face limitations such as reliance on initial guesses, labor-intensive fitting procedures, and complex testing setups. On the other hand, purely data-driven machine learning methods struggle to capture inherent physical constraints and typically require large datasets for optimal performance. To address these challenges, this paper introduces the Fine-Tuning Hybrid Dynamics (FTHD) method, which integrates supervised and unsupervised Physics-Informed Neural Networks, combining physics-based modeling with data-driven techniques. FTHD fine-tunes a pre-trained Deep Dynamics Model (DDM) using a smaller training dataset, delivering superior performance compared to state-of-the-art methods such as the Deep Pacejka Model and outperforming the original DDM. Furthermore, an Extended Kalman Filter (EKF) is embedded within FTHD (EKF-FTHD) to effectively manage noisy real-world data, ensuring accurate denoising while preserving the vehicle’s essential physical characteristics. The proposed FTHD framework is validated through scaled simulations using the BayesRace Physics-based Simulator and full-scale real-world experiments from the Indy Autonomous Challenge. Results demonstrate that the hybrid approach significantly improves parameter estimation accuracy, even with reduced data, and outperforms existing models. EKF-FTHD enhances robustness by denoising real-world data while maintaining physical insights, representing a notable advancement in vehicle dynamics modeling for high-speed autonomous racing.
- Open Access
Fine-Tuning Hybrid Physics-Informed Neural Networks for Vehicle Dynamics Model Estimation
Accurate dynamic modeling is critical for autonomous racing vehicles, especially during high-speed and agile maneuvers where precise motion prediction is essential for safety. Traditional parameter estimation methods face limitations such as reliance on initial guesses, labor-intensive fitting procedures, and complex testing setups. On the other hand, purely data-driven machine learning methods struggle to capture inherent physical constraints and typically require large datasets for optimal performance. To address these challenges, this paper introduces the Fine-Tuning Hybrid Dynamics (FTHD) method, which integrates supervised and unsupervised Physics-Informed Neural Networks (PINNs), combining physics-based modeling with data-driven techniques. FTHD fine-tunes a pre-trained Deep Dynamics Model (DDM) using a smaller training dataset, delivering superior performance compared to state-of-the-art methods such as the Deep Pacejka Model (DPM) and outperforming the original DDM. Furthermore, an Extended Kalman Filter (EKF) is embedded within FTHD (EKF-FTHD) to effectively manage noisy real-world data, ensuring accurate denoising while preserving the vehicle's essential physical characteristics. The proposed FTHD framework is validated through scaled simulations using the BayesRace Physics-based Simulator and full-scale real-world experiments from the Indy Autonomous Challenge. Results demonstrate that the hybrid approach significantly improves parameter estimation accuracy, even with reduced data, and outperforms existing models. EKF-FTHD enhances robustness by denoising real-world data while maintaining physical insights, representing a notable advancement in vehicle dynamics modeling for high-speed autonomous racing.
Open AccessFine-Tuning Hybrid Physics-Informed Neural Networks for Vehicle Dynamics Model Estimation
Accurate dynamic modeling is critical for autonomous racing vehicles, especially during high-speed and agile maneuvers where precise motion prediction is essential for safety. Traditional parameter estimation methods face limitations such as reliance on initial guesses, labor-intensive fitting procedures, and complex testing setups. On the other hand, purely data-driven machine learning methods struggle to capture inherent physical constraints and typically require large datasets for optimal performance. To address these challenges, this paper introduces the Fine-Tuning Hybrid Dynamics (FTHD) method, which integrates supervised and unsupervised Physics-Informed Neural Networks (PINNs), combining physics-based modeling with data-driven techniques. FTHD fine-tunes a pre-trained Deep Dynamics Model (DDM) using a smaller training dataset, delivering superior performance compared to state-of-the-art methods such as the Deep Pacejka Model (DPM) and outperforming the original DDM. Furthermore, an Extended Kalman Filter (EKF) is embedded within FTHD (EKF-FTHD) to effectively manage noisy real-world data, ensuring accurate denoising while preserving the vehicle's essential physical characteristics. The proposed FTHD framework is validated through scaled simulations using the BayesRace Physics-based Simulator and full-scale real-world experiments from the Indy Autonomous Challenge. Results demonstrate that the hybrid approach significantly improves parameter estimation accuracy, even with reduced data, and outperforms existing models. EKF-FTHD enhances robustness by denoising real-world data while maintaining physical insights, representing a notable advancement in vehicle dynamics modeling for high-speed autonomous racing.
- 30 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 21 (3) , 2321-2334
Learning-Based Auto-Focus and 3D Pose Identification of Moving Micro- and Nanowires in Fluid Suspensions
Precise manipulation of micro-and nano-objects through visual feedback is challenging because of the difficulty of observing their motion along the line-of-sight of microscopes. This paper presents an efficient learning-based auto-focus (AF) and visual posture estimation scheme for tracking the three-dimensional (3D) poses of multiple moving micro-and nanowires in fluid suspensions under bright-field microscopes. The proposed AF and 3D pose estimation methods integrate convolutional neural networks (CNNs) to precisely identify the focal distances and inclination angles of multiple moving wires through a single region-of-interest (ROI) image for each wire. Furthermore, we demonstrate the versatility of the proposed AF method by adapting it for wires of other materials through transfer learning (TF), using a limited dataset. Extensive experimental results validate the high accuracy and efficiency of AF and 3D pose estimation compared to traditional methods. This work lays the foundation for the automated control of micro-and nano-objects in 3D microfluidic environments. Note to Practitioners —Autonomous manipulation of multiple micro-and nanoscale objects is of major interest for various research applications. However, precise manipulation of micro-and nanowires through visual feedback is challenging because of the difficulty in focusing microscopes on their 3D pose or orientation to the x, y, and z axes as they move in the depth direction. Traditionally, achieving AF involves using one or more image metrics to evaluate image quality by performing a series of mechanical movements to locate the peak sharpness using optimization methods. In contrast, this paper proposes a learning-based approach that uses CNNs to estimate the positions of the focal planes and identify the 3D positions and orientations of multiple moving micro-and nanowires from a single ROI image. Extensive experiments demonstrate that the learning-based methods exhibit higher stability, extended duration, and faster converging speed of tracking and 3D pose estimation compared to traditional methods. This work facilitates researchers’ ability to observe and manipulate micro-and nano-objects under microscopes in 3D microfluidic environments.
- 30 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 21 (3) , 2321-2334
Learning-Based Auto-Focus and 3D Pose Identification of Moving Micro- and Nanowires in Fluid Suspensions
Precise manipulation of micro-and nano-objects through visual feedback is challenging because of the difficulty of observing their motion along the line-of-sight of microscopes. This paper presents an efficient learning-based auto-focus (AF) and visual posture estimation scheme for tracking the three-dimensional (3D) poses of multiple moving micro-and nanowires in fluid suspensions under bright-field microscopes. The proposed AF and 3D pose estimation methods integrate convolutional neural networks (CNNs) to precisely identify the focal distances and inclination angles of multiple moving wires through a single region-of-interest (ROI) image for each wire. Furthermore, we demonstrate the versatility of the proposed AF method by adapting it for wires of other materials through transfer learning (TF), using a limited dataset. Extensive experimental results validate the high accuracy and efficiency of AF and 3D pose estimation compared to traditional methods. This work lays the foundation for the automated control of micro-and nano-objects in 3D microfluidic environments. Note to Practitioners —Autonomous manipulation of multiple micro-and nanoscale objects is of major interest for various research applications. However, precise manipulation of micro-and nanowires through visual feedback is challenging because of the difficulty in focusing microscopes on their 3D pose or orientation to the x, y, and z axes as they move in the depth direction. Traditionally, achieving AF involves using one or more image metrics to evaluate image quality by performing a series of mechanical movements to locate the peak sharpness using optimization methods. In contrast, this paper proposes a learning-based approach that uses CNNs to estimate the positions of the focal planes and identify the 3D positions and orientations of multiple moving micro-and nanowires from a single ROI image. Extensive experiments demonstrate that the learning-based methods exhibit higher stability, extended duration, and faster converging speed of tracking and 3D pose estimation compared to traditional methods. This work facilitates researchers’ ability to observe and manipulate micro-and nano-objects under microscopes in 3D microfluidic environments.
- 22 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 40 (15523098) , 2850-2867
Complete and Near-Optimal Robotic Crack Coverage and Filling in Civil Infrastructure
We present a simultaneous sensor-based inspection and footprint coverage (SIFC) planning and control design with applications to autonomous robotic crack mapping and filling. The main challenge of the SIFC problem lies in the coupling of complete sensing (for mapping) and robotic footprint (for filling) coverage tasks. Initially, we assume known target information (e.g., cracks) and employ classic cell decomposition methods to achieve complete sensing coverage of the workspace and complete robotic footprint coverage using the least-cost route. Subsequently, we generalize the algorithm to handle unknown target information, allowing the robot to scan and incrementally construct the target map online while conducting robotic footprint coverage. The online polynomial-time SIFC planning algorithm minimizes the total robot traveling distance, guarantees complete sensing coverage of the entire workspace, and achieves near-optimal robotic footprint coverage, as demonstrated through empirical experiments. For the demonstrated application, we design coordinated nozzle motion control with the planned robot trajectory to efficiently fill all cracks within the robot's footprint. Experimental results illustrate the algorithm's design, performance, and comparisons. The SIFC algorithm offers a high-efficiency motion planning solution for various robotic applications requiring simultaneous sensing and actuation coverage.
- 22 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 40 (15523098) , 2850-2867
Complete and Near-Optimal Robotic Crack Coverage and Filling in Civil Infrastructure
We present a simultaneous sensor-based inspection and footprint coverage (SIFC) planning and control design with applications to autonomous robotic crack mapping and filling. The main challenge of the SIFC problem lies in the coupling of complete sensing (for mapping) and robotic footprint (for filling) coverage tasks. Initially, we assume known target information (e.g., cracks) and employ classic cell decomposition methods to achieve complete sensing coverage of the workspace and complete robotic footprint coverage using the least-cost route. Subsequently, we generalize the algorithm to handle unknown target information, allowing the robot to scan and incrementally construct the target map online while conducting robotic footprint coverage. The online polynomial-time SIFC planning algorithm minimizes the total robot traveling distance, guarantees complete sensing coverage of the entire workspace, and achieves near-optimal robotic footprint coverage, as demonstrated through empirical experiments. For the demonstrated application, we design coordinated nozzle motion control with the planned robot trajectory to efficiently fill all cracks within the robot's footprint. Experimental results illustrate the algorithm's design, performance, and comparisons. The SIFC algorithm offers a high-efficiency motion planning solution for various robotic applications requiring simultaneous sensing and actuation coverage.
- 24 February 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 21 (2) , 1488-1500
Motion Planning and Control of Autonomous Aggressive Vehicle Maneuvers
Aggressive vehicle maneuvers such as those performed by professional racing drivers achieve high agility motion at the edge of handling limits. These aggressive maneuvers can be used to design human-inspired active safety features for next-generation “accident-free” vehicles. We present a motion planning and control design for autonomous aggressive vehicle maneuvers. The motion planner takes advantages of the sparse stable trees and the enhanced rapidly exploring random tree (RRT*) algorithms. The use of the sparsity property helps to reduce the computational cost of the RRT* method by removing non-useful nodes in each iteration and therefore to rapidly converge to the optimal solution. The proposed motion control design allows the vehicle to operate outside the stability region to accomplish a safe, agile maneuver. A safety region is computed to augment the stability region and the motion control is built on a modified nonlinear model predictive control method. We implement the proposed planner and controller and demonstrate the autonomous aggressive maneuvers on a 1/7-scale racing vehicle platform. Comparison with human expert driver and other existing methods is also presented to demonstrate the performance and robustness. Note to Practitioners —Motion planning and control of human driver-inspired aggressive vehicle maneuvers is a challenging task because of high-agility, unstable fast vehicle motions. This paper is motivated by addressing this challenge in autonomous driving technologies. Instead of restricting vehicle motions within a stability region that is taken by existing methods, we augment the conservative stability region to a safety region with guaranteed performance. To improve the computational efficiency of sampling-based motion planners, we take advantage of sparsity and also integration of a nonlinear predictive control method to compute feasible vehicle motion in searching space. The stability of the vehicle motion controller and sub-optimality of the motion planner are analyzed and guaranteed. Using a scaled vehicle testbed, we validate and compare the proposed motion planning and control design with other existing methods and human expert driver. The experimental results demonstrate the superior performance than the other methods and comparable with human expert driving skills.
- 24 February 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 21 (2) , 1488-1500
Motion Planning and Control of Autonomous Aggressive Vehicle Maneuvers
Aggressive vehicle maneuvers such as those performed by professional racing drivers achieve high agility motion at the edge of handling limits. These aggressive maneuvers can be used to design human-inspired active safety features for next-generation “accident-free” vehicles. We present a motion planning and control design for autonomous aggressive vehicle maneuvers. The motion planner takes advantages of the sparse stable trees and the enhanced rapidly exploring random tree (RRT*) algorithms. The use of the sparsity property helps to reduce the computational cost of the RRT* method by removing non-useful nodes in each iteration and therefore to rapidly converge to the optimal solution. The proposed motion control design allows the vehicle to operate outside the stability region to accomplish a safe, agile maneuver. A safety region is computed to augment the stability region and the motion control is built on a modified nonlinear model predictive control method. We implement the proposed planner and controller and demonstrate the autonomous aggressive maneuvers on a 1/7-scale racing vehicle platform. Comparison with human expert driver and other existing methods is also presented to demonstrate the performance and robustness. Note to Practitioners —Motion planning and control of human driver-inspired aggressive vehicle maneuvers is a challenging task because of high-agility, unstable fast vehicle motions. This paper is motivated by addressing this challenge in autonomous driving technologies. Instead of restricting vehicle motions within a stability region that is taken by existing methods, we augment the conservative stability region to a safety region with guaranteed performance. To improve the computational efficiency of sampling-based motion planners, we take advantage of sparsity and also integration of a nonlinear predictive control method to compute feasible vehicle motion in searching space. The stability of the vehicle motion controller and sub-optimality of the motion planner are analyzed and guaranteed. Using a scaled vehicle testbed, we validate and compare the proposed motion planning and control design with other existing methods and human expert driver. The experimental results demonstrate the superior performance than the other methods and comparable with human expert driving skills.
- 8 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 20 (3) , 1838-1850
Adaptive Tube Model Predictive Control for Manipulating Micro- and Nanoparticles in Fluid Suspensions Under Global External Fields
Global external fields are commonly used to manipulate micro-and nanoparticles in fluid suspension. However, the wireless external actuation has global and coupled influences in the workspace, which limit the robust, independent, and simultaneous control of multiple micro-and nanoparticles. Parametric uncertainty in the particles’ motion model and disturbance make it difficult to steer multiple particles precisely. In this paper, an adaptive tube model predictive control (MPC) scheme is proposed to simultaneously control multiple micro-and nanoparticles in fluid suspensions. The control strategy addresses coupled input actuation from the global electric fields. The unknown mobilities of the particles are continually estimated online, which enables the construction of dynamic tubes of individual particles. The recursive feasibility and the input-to-state stability (ISS) of the scheme are proven. The manipulability of the electrophoresis-based microfluidic manipulation system is quantified and analyzed. The manipulability is affected by the dimensions of the actuating electrodes, the number of particles to be simultaneously and independently controlled, and the configurations of those particles in the microfluidic device. The scalability of the lattice-shaped distributed array of electrodes is discussed. Simulation and experimental results validate the effectiveness of the controller to manipulate multiple particles precisely, independently, and simultaneously. Note to Practitioners—To enable the enormous potential of manufacturing functional micro-and nanodevices, it is crucial to automate the steering and manipulation of multiple micro-and nanoparticles. Wireless actuation is a promising way to position those objects in fluid suspensions. However, the global and coupled influences from the wireless external actuation, the parametric uncertainty in the particles’ motion model, and the external disturbances from the fluid flow limit the robust, independent, and simultaneous control of multiple micro-and nanoparticles. In this paper, we present an adaptive tube model predictive control (MPC) scheme to simultaneously control multiple micro-and nanoparticles in fluid suspensions using electric fields. The scheme estimates the unknown mobilities of the particles, constructs dynamic tubes online, and addresses the coupled actuation from the global electric field. The manipulability of the electrophoresis-based microfluidic manipulation system is introduced, quantified, and analyzed. Those analyses give insights into designing the most effective electrode array and the efficient trajectories to achieve agile particle motions. Experimental results validate the manipulability analyses and the performance of the proposed control strategy.
- 8 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 20 (3) , 1838-1850
Adaptive Tube Model Predictive Control for Manipulating Micro- and Nanoparticles in Fluid Suspensions Under Global External Fields
Global external fields are commonly used to manipulate micro-and nanoparticles in fluid suspension. However, the wireless external actuation has global and coupled influences in the workspace, which limit the robust, independent, and simultaneous control of multiple micro-and nanoparticles. Parametric uncertainty in the particles’ motion model and disturbance make it difficult to steer multiple particles precisely. In this paper, an adaptive tube model predictive control (MPC) scheme is proposed to simultaneously control multiple micro-and nanoparticles in fluid suspensions. The control strategy addresses coupled input actuation from the global electric fields. The unknown mobilities of the particles are continually estimated online, which enables the construction of dynamic tubes of individual particles. The recursive feasibility and the input-to-state stability (ISS) of the scheme are proven. The manipulability of the electrophoresis-based microfluidic manipulation system is quantified and analyzed. The manipulability is affected by the dimensions of the actuating electrodes, the number of particles to be simultaneously and independently controlled, and the configurations of those particles in the microfluidic device. The scalability of the lattice-shaped distributed array of electrodes is discussed. Simulation and experimental results validate the effectiveness of the controller to manipulate multiple particles precisely, independently, and simultaneously. Note to Practitioners—To enable the enormous potential of manufacturing functional micro-and nanodevices, it is crucial to automate the steering and manipulation of multiple micro-and nanoparticles. Wireless actuation is a promising way to position those objects in fluid suspensions. However, the global and coupled influences from the wireless external actuation, the parametric uncertainty in the particles’ motion model, and the external disturbances from the fluid flow limit the robust, independent, and simultaneous control of multiple micro-and nanoparticles. In this paper, we present an adaptive tube model predictive control (MPC) scheme to simultaneously control multiple micro-and nanoparticles in fluid suspensions using electric fields. The scheme estimates the unknown mobilities of the particles, constructs dynamic tubes online, and addresses the coupled actuation from the global electric field. The manipulability of the electrophoresis-based microfluidic manipulation system is introduced, quantified, and analyzed. Those analyses give insights into designing the most effective electrode array and the efficient trajectories to achieve agile particle motions. Experimental results validate the manipulability analyses and the performance of the proposed control strategy.
- 15 March 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 19 (3) , 1422-1433
Informed Sampling-Based Motion Planning for Manipulating Multiple Micro Agents Using Global External Electric Fields
Online manipulation of multiple micro- and nanoscale agents is of major interest for various research applications. Among the biggest limitations of wireless external actuation are its global and coupled influences in the workspace, which limit the robust manipulation of multiple agents independently and simultaneously. In this paper, we propose novel motion planning algorithms, $\tt Bi$ - $\tt iSST$ and $\tt Ref$ - $\tt iSST$ , to quickly generate time-optimal trajectories for multiple agents sharing global external fields. Both algorithms are extended by the stable sparse rapidly-exploring random tree kinodynamic motion planning algorithm. The $\tt Bi$ - $\tt iSST$ uses a bidirectional approach to speed up the searching process. A novel connection process is proposed to connect the two trees efficiently by applying an optimization procedure. The $\tt Ref$ - $\tt iSST$ uses the workspace information to quickly generate global-routing trajectories as references, then guides the search process more effectively by getting more accurate heuristics according to the reference global-routing trajectories. A transition matrix similar to that in Markov Decision Processes is used to form the reference trajectory. Compared with the state-of-the-art $\tt iSST$ algorithm, the proposed algorithms quickly update feasible solutions and converge to a near-optimal, minimum-time solution to increase the efficiency of the simultaneous manipulation of multiple micro agents using global external fields. Extensive analysis and physical experiments are presented to confirm the effectiveness and the performance of the motion planning algorithms. Note to Practitioners —Autonomous manipulation of multiple micro- and nanoscale agents is of major interest for various research applications. Wireless actuation is a promising way to position those objects. The commonly used non-contact actuation techniques include magnetic actuation, electrical field actuation, optical tweezers, and actuated flows, etc. Among the biggest limitations of wireless external actuation are its global and coupled influences in the workspace, which limit the capability to robustly manipulate multiple agents independently and simultaneously. In this paper, we propose novel bidirectional informed sampling-based motion planning algorithms to quickly generate time-optimal trajectories for multiple agents sharing global external fields. Novel heuristics and informed reference trajectory are used to guide the search for manipulating multiple agents under global fields. Numerical simulations and physical experiments are presented to demonstrate the performance of the motion planning design. The proposed algorithm guarantees anytime performance and quickly converges to a near-optimal minimum time solution for multiple agents. Although we focus on the electric-field actuated multiple-micro-agent system, the proposed motion planning strategies are not limited to the actuation and can be generalized to other field-based applications, in which the actuation among a group of multiple agents are coupled or intertwined.
- 15 March 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 19 (3) , 1422-1433
Informed Sampling-Based Motion Planning for Manipulating Multiple Micro Agents Using Global External Electric Fields
Online manipulation of multiple micro- and nanoscale agents is of major interest for various research applications. Among the biggest limitations of wireless external actuation are its global and coupled influences in the workspace, which limit the robust manipulation of multiple agents independently and simultaneously. In this paper, we propose novel motion planning algorithms, $\tt Bi$ - $\tt iSST$ and $\tt Ref$ - $\tt iSST$ , to quickly generate time-optimal trajectories for multiple agents sharing global external fields. Both algorithms are extended by the stable sparse rapidly-exploring random tree kinodynamic motion planning algorithm. The $\tt Bi$ - $\tt iSST$ uses a bidirectional approach to speed up the searching process. A novel connection process is proposed to connect the two trees efficiently by applying an optimization procedure. The $\tt Ref$ - $\tt iSST$ uses the workspace information to quickly generate global-routing trajectories as references, then guides the search process more effectively by getting more accurate heuristics according to the reference global-routing trajectories. A transition matrix similar to that in Markov Decision Processes is used to form the reference trajectory. Compared with the state-of-the-art $\tt iSST$ algorithm, the proposed algorithms quickly update feasible solutions and converge to a near-optimal, minimum-time solution to increase the efficiency of the simultaneous manipulation of multiple micro agents using global external fields. Extensive analysis and physical experiments are presented to confirm the effectiveness and the performance of the motion planning algorithms. Note to Practitioners —Autonomous manipulation of multiple micro- and nanoscale agents is of major interest for various research applications. Wireless actuation is a promising way to position those objects. The commonly used non-contact actuation techniques include magnetic actuation, electrical field actuation, optical tweezers, and actuated flows, etc. Among the biggest limitations of wireless external actuation are its global and coupled influences in the workspace, which limit the capability to robustly manipulate multiple agents independently and simultaneously. In this paper, we propose novel bidirectional informed sampling-based motion planning algorithms to quickly generate time-optimal trajectories for multiple agents sharing global external fields. Novel heuristics and informed reference trajectory are used to guide the search for manipulating multiple agents under global fields. Numerical simulations and physical experiments are presented to demonstrate the performance of the motion planning design. The proposed algorithm guarantees anytime performance and quickly converges to a near-optimal minimum time solution for multiple agents. Although we focus on the electric-field actuated multiple-micro-agent system, the proposed motion planning strategies are not limited to the actuation and can be generalized to other field-based applications, in which the actuation among a group of multiple agents are coupled or intertwined.
- 14 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (2) , 2423-2430
Monocular Visual-Inertial Sensing of Unknown Rotating Objects: Observability Analyses and Case Study for Metric 3D Reconstructing of Space Debris
The fusion of a monocular camera and an inertial sensor (i.e., IMU) can help the autonomous navigation ability of a mobile robot, as well as obtain the environmental information. However, it is difficult to adapt the fusion for dynamic objects. Although several recent studies have tracked or even retrieved simple structural information about dynamic objects, there is no reported visual-inertial sensing research for unknown rotating objects, especially for those that are not surrounded by any static environmental visual feature. In fact, such rotating objects indeed represent a class of real and challenging scenarios, e.g., space debris. This letter discusses the monocular visual-inertial sensing of unknown rotating objects. Our first contribution is the comprehensive nonlinear observability analyses. We theoretically prove that the monocular visual-inertial sensing possesses favourable observability properties with respect to rotating objects, and we derive all observable and unobservable modes for the cases with unknown gravity and without gravity. The second contribution of this letter is a validation case study, i.e., the metric 3D reconstruction of space debris by means of a micro space robot. We propose a practical inertial sensor-assisted Structure from Motion strategy that can perceive rotating space debris. The experiment demonstrates that by using only the onboard monocular camera and IMU, the robot can obtain sufficient information about the space debris, such as all rotation parameters and even a dense point cloud model with absolute metric scale information. This case study confirms our theoretical results.
- 14 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (2) , 2423-2430
Monocular Visual-Inertial Sensing of Unknown Rotating Objects: Observability Analyses and Case Study for Metric 3D Reconstructing of Space Debris
The fusion of a monocular camera and an inertial sensor (i.e., IMU) can help the autonomous navigation ability of a mobile robot, as well as obtain the environmental information. However, it is difficult to adapt the fusion for dynamic objects. Although several recent studies have tracked or even retrieved simple structural information about dynamic objects, there is no reported visual-inertial sensing research for unknown rotating objects, especially for those that are not surrounded by any static environmental visual feature. In fact, such rotating objects indeed represent a class of real and challenging scenarios, e.g., space debris. This letter discusses the monocular visual-inertial sensing of unknown rotating objects. Our first contribution is the comprehensive nonlinear observability analyses. We theoretically prove that the monocular visual-inertial sensing possesses favourable observability properties with respect to rotating objects, and we derive all observable and unobservable modes for the cases with unknown gravity and without gravity. The second contribution of this letter is a validation case study, i.e., the metric 3D reconstruction of space debris by means of a micro space robot. We propose a practical inertial sensor-assisted Structure from Motion strategy that can perceive rotating space debris. The experiment demonstrates that by using only the onboard monocular camera and IMU, the robot can obtain sufficient information about the space debris, such as all rotation parameters and even a dense point cloud model with absolute metric scale information. This case study confirms our theoretical results.