Kui Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Kui Wang has a total of 47 co-authors. Here are the top co-authors by number of shared publications:
- Ka-Wai Kwok
Department of Mechanical Engineering, The University of Hong Kong, Hong Kong SAR, China
8 shared publications - Ge Fang
College of Artificial Intelligence, Nankai University, Tianjin, China
5 shared publications - Justin Di-Lang Ho
Department of Mechanical Engineering, The University of Hong Kong, Hong Kong
5 shared publications - Xiaomei Wang
Department of Mechanical Engineering The University of Hong Kong Hong Kong 999077 China
4 shared publications Kaspar Althoefer
3 shared publications- Kit-Hang Lee
Mechanical Engineering, The University of Hong Kong, Hong Kong China 0000
3 shared publications
Latest Publications
- Open Access
- 19 April 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 39 (4) , 3043-3058
A Fast Soft Robotic Laser Sweeping System Using Data-Driven Modeling Approach
Soft robots have great potential in surgical applications due to their compliance and adaptability to their environment. However, their flexibility and nonlinearity bring challenges for precise modeling, sensing, and control, especially in constrained cavities. In this article, a simple, compact two-segment soft robot for flexible laser ablation is proposed. The proximal hydraulic-driven segment can offer omnidirectional bending so as to navigate toward lesions. The distal segment driven by tendons enables precise, fast steering of laser collimator for laser sweeping on lesion targets. The dynamics of such mechanical steering motion can be enhanced with a metal spring backbone integrated along the collimator, thus facilitating the control with certain linearity and responsiveness. A soft robot modeling and control scheme based on Koopman operators is proposed. We also design a disturbance observer so as to incorporate the controller feedback with real-time fiber optic shape sensing. Experimental validation is conducted on simulated or ex-vivo laser ablation tasks, thus evaluating our control strategies in laser path following across various contours/patterns. As a result, such a simple compact laser manipulation can perform up to 6 Hz sweeping with precision of path following errors below 1 mm. Such modeling and control scheme could also be used on an endoscopic laser ablation robot with unsymmetric mechanism driven by two tendons.
- 19 April 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 39 (4) , 3043-3058
Open AccessA Fast Soft Robotic Laser Sweeping System Using Data-Driven Modeling Approach
Soft robots have great potential in surgical applications due to their compliance and adaptability to their environment. However, their flexibility and nonlinearity bring challenges for precise modeling, sensing, and control, especially in constrained cavities. In this article, a simple, compact two-segment soft robot for flexible laser ablation is proposed. The proximal hydraulic-driven segment can offer omnidirectional bending so as to navigate toward lesions. The distal segment driven by tendons enables precise, fast steering of laser collimator for laser sweeping on lesion targets. The dynamics of such mechanical steering motion can be enhanced with a metal spring backbone integrated along the collimator, thus facilitating the control with certain linearity and responsiveness. A soft robot modeling and control scheme based on Koopman operators is proposed. We also design a disturbance observer so as to incorporate the controller feedback with real-time fiber optic shape sensing. Experimental validation is conducted on simulated or ex-vivo laser ablation tasks, thus evaluating our control strategies in laser path following across various contours/patterns. As a result, such a simple compact laser manipulation can perform up to 6 Hz sweeping with precision of path following errors below 1 mm. Such modeling and control scheme could also be used on an endoscopic laser ablation robot with unsymmetric mechanism driven by two tendons.
- Open Access
- 24 February 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 39 (3) , 2448-2467
Learning-Based Visual-Strain Fusion for Eye-in-Hand Continuum Robot Pose Estimation and Control
Image processing has significantly extended the practical value of the eye-in-hand camera, enabling and promoting its applications for quantitative measurement. However, fully vision-based pose estimation methods sometimes encounter difficulties in handling cases with deficient features. In this article, we fuse visual information with the sparse strain data collected from a single-core fiber inscribed with fiber Bragg gratings (FBGs) to facilitate continuum robot pose estimation. An improved extreme learning machine algorithm with selective training data updates is implemented to establish and refine the FBG-empowered (F-emp) pose estimator online . The integration of F-emp pose estimation can improve sensing robustness by reducing the number of times that visual tracking is lost given moving visual obstacles and varying lighting. In particular, this integration solves pose estimation failures under full occlusion of the tracked features or complete darkness. Utilizing the fused pose feedback, a hybrid controller incorporating kinematics and data-driven algorithms is proposed to accomplish fast convergence with high accuracy. The online-learning error compensator can improve the target tracking performance with a 52.3%–90.1% error reduction compared with constant-curvature model-based control, without requiring fine model-parameter tuning and prior data acquisition.
- 24 February 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 39 (3) , 2448-2467
Open AccessLearning-Based Visual-Strain Fusion for Eye-in-Hand Continuum Robot Pose Estimation and Control
Image processing has significantly extended the practical value of the eye-in-hand camera, enabling and promoting its applications for quantitative measurement. However, fully vision-based pose estimation methods sometimes encounter difficulties in handling cases with deficient features. In this article, we fuse visual information with the sparse strain data collected from a single-core fiber inscribed with fiber Bragg gratings (FBGs) to facilitate continuum robot pose estimation. An improved extreme learning machine algorithm with selective training data updates is implemented to establish and refine the FBG-empowered (F-emp) pose estimator online . The integration of F-emp pose estimation can improve sensing robustness by reducing the number of times that visual tracking is lost given moving visual obstacles and varying lighting. In particular, this integration solves pose estimation failures under full occlusion of the tracked features or complete darkness. Utilizing the fused pose feedback, a hybrid controller incorporating kinematics and data-driven algorithms is proposed to accomplish fast convergence with high accuracy. The online-learning error compensator can improve the target tracking performance with a 52.3%–90.1% error reduction compared with constant-curvature model-based control, without requiring fine model-parameter tuning and prior data acquisition.
- Open Access
- 30 January 2023
- Published by Wiley
Supporting Information for "Intelligent Shape Decoding of a Soft Optical Waveguide Sensor"
Figure S1. (A) LED & PD placement of the fish-shaped waveguide sensor. (B) Sandwiched PDMS structure of the soft waveguide sensor, where opaque and semi-opaque layers are silicone-dyed to enable internal reflection.
- 30 January 2023
- Published by Wiley
Open AccessSupporting Information for "Intelligent Shape Decoding of a Soft Optical Waveguide Sensor"
Figure S1. (A) LED & PD placement of the fish-shaped waveguide sensor. (B) Sandwiched PDMS structure of the soft waveguide sensor, where opaque and semi-opaque layers are silicone-dyed to enable internal reflection.
- Open Access
- 30 August 2021
- Published by Wiley in Advanced Intelligent Systems
- Vol. 3 (11) , 2100089
Large‐Scale Surface Shape Sensing with Learning‐Based Computational Mechanics
Proprioception, the ability to perceive one's own configuration and movement in space, enables organisms to safely and accurately interact with their environment and each other. The underlying sensory nerves that make this possible are highly dense and use sophisticated communication pathways to propagate signals from nerves in muscle, skin, and joints to the central nervous system wherein the organism can process and react to stimuli. In a step forward to realize robots with such perceptive capability, a flexible sensor framework that incorporates a novel modeling strategy, taking advantage of computational mechanics and machine learning, is proposed. The sensor framework on a large flexible sensor that transforms sparsely distributed strains into continuous surface is implemented. Finite element (FE) analysis is utilized to determine design parameters, while an FE model is built to enrich the morphological data used in the supervised training to achieve continuous surface reconstruction. A mapping between the local strain data and the enriched surface data is subsequently trained using ensemble learning. This hybrid approach enables real time, robust, and high‐order surface reconstruction. The sensing performance is evaluated in terms of accuracy, repeatability, and feasibility with numerous scenarios, which has not been demonstrated on such a large‐scale sensor before.
- 30 August 2021
- Published by Wiley in Advanced Intelligent Systems
- Vol. 3 (11) , 2100089
Open AccessLarge‐Scale Surface Shape Sensing with Learning‐Based Computational Mechanics
Proprioception, the ability to perceive one's own configuration and movement in space, enables organisms to safely and accurately interact with their environment and each other. The underlying sensory nerves that make this possible are highly dense and use sophisticated communication pathways to propagate signals from nerves in muscle, skin, and joints to the central nervous system wherein the organism can process and react to stimuli. In a step forward to realize robots with such perceptive capability, a flexible sensor framework that incorporates a novel modeling strategy, taking advantage of computational mechanics and machine learning, is proposed. The sensor framework on a large flexible sensor that transforms sparsely distributed strains into continuous surface is implemented. Finite element (FE) analysis is utilized to determine design parameters, while an FE model is built to enrich the morphological data used in the supervised training to achieve continuous surface reconstruction. A mapping between the local strain data and the enriched surface data is subsequently trained using ensemble learning. This hybrid approach enables real time, robust, and high‐order surface reconstruction. The sensing performance is evaluated in terms of accuracy, repeatability, and feasibility with numerous scenarios, which has not been demonstrated on such a large‐scale sensor before.
- 11 August 2021
- Published by American Association for the Advancement of Science (AAAS) in Science Robotics
- Vol. 6 (57)
Soft robotic manipulator for intraoperative MRI-guided transoral laser microsurgery
A compact and dexterous magnetic resonance (MR)–safe soft robot enables MR imaging–guided transoral laser microsurgery.
- 11 August 2021
- Published by American Association for the Advancement of Science (AAAS) in Science Robotics
- Vol. 6 (57)
Soft robotic manipulator for intraoperative MRI-guided transoral laser microsurgery
A compact and dexterous magnetic resonance (MR)–safe soft robot enables MR imaging–guided transoral laser microsurgery.
- Open Access
- 6 July 2021
- Published by Wiley
Supporting Information for "Large-scale Surface Shape Sensing with Learning-based Computational Mechanics"
Proprioception, the ability to perceive one’s own configuration and movement in space, enables organisms to safely and accurately interact with their environment and each other. The underlying sensory nerves that make this possible are highly dense and use sophisticated communication pathways to propagate signals from nerves in muscle, skin and joints to the central nervous system wherein the organism can process and react to stimuli. In a step forward to realize robots with such perceptive capability, we propose a flexible sensor framework that incorporates a novel hybrid modeling strategy, taking advantage of computational mechanics and machine learning. We implement the sensor framework on a large, thin and flexible sensor that transforms sparsely distributed strains into continuous surface shape. Finite element (FE) analysis is utilized to determine sensor design parameters, while an FE model is built to enrich the morphological data used in the supervised training to achieve continuous surface reconstruction. A mapping between the local strain data and the enriched surface data is subsequently trained using ensemble learning. This hybrid approach enables real-time, robust and high-order surface shape reconstruction. The sensing performance is evaluated in terms of accuracy, repeatability, and feasibility with numerous scenarios, which has not been demonstrated and reported on such a large-scale (A4-paper-size) sensor before.
- 6 July 2021
- Published by Wiley
Open AccessSupporting Information for "Large-scale Surface Shape Sensing with Learning-based Computational Mechanics"
Proprioception, the ability to perceive one’s own configuration and movement in space, enables organisms to safely and accurately interact with their environment and each other. The underlying sensory nerves that make this possible are highly dense and use sophisticated communication pathways to propagate signals from nerves in muscle, skin and joints to the central nervous system wherein the organism can process and react to stimuli. In a step forward to realize robots with such perceptive capability, we propose a flexible sensor framework that incorporates a novel hybrid modeling strategy, taking advantage of computational mechanics and machine learning. We implement the sensor framework on a large, thin and flexible sensor that transforms sparsely distributed strains into continuous surface shape. Finite element (FE) analysis is utilized to determine sensor design parameters, while an FE model is built to enrich the morphological data used in the supervised training to achieve continuous surface reconstruction. A mapping between the local strain data and the enriched surface data is subsequently trained using ensemble learning. This hybrid approach enables real-time, robust and high-order surface shape reconstruction. The sensing performance is evaluated in terms of accuracy, repeatability, and feasibility with numerous scenarios, which has not been demonstrated and reported on such a large-scale (A4-paper-size) sensor before.
- 28 January 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 5 (2) , 2161-2168
Eye-in-Hand Visual Servoing Enhanced With Sparse Strain Measurement for Soft Continuum Robots
In the feature/object tracking of eye-in-hand visual servoing, 2D motion estimation relying only on image plane feedback is easily affected by vision occlusion, blurring, or poor lighting. For the commonly-used template matching method, tracking performance greatly depends on the image quality. Fiber Bragg gratings (FBGs), a type of high-frequency flexible strain sensor, can be used as an assistant device for soft robot control. We propose a method to enhance motion estimation in soft robotic visual servoing by fusing the results from template matching and FBG wavelength shifts to achieve more accurate tracking in applications such as minimally invasive surgery. Path following performance is validated in a simulated laparoscopic scene and LEGO®-constructed scene, demonstrating significant improvement to feature tracking and robot motion, even under external forces.
- 28 January 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 5 (2) , 2161-2168
Eye-in-Hand Visual Servoing Enhanced With Sparse Strain Measurement for Soft Continuum Robots
In the feature/object tracking of eye-in-hand visual servoing, 2D motion estimation relying only on image plane feedback is easily affected by vision occlusion, blurring, or poor lighting. For the commonly-used template matching method, tracking performance greatly depends on the image quality. Fiber Bragg gratings (FBGs), a type of high-frequency flexible strain sensor, can be used as an assistant device for soft robot control. We propose a method to enhance motion estimation in soft robotic visual servoing by fusing the results from template matching and FBG wavelength shifts to achieve more accurate tracking in applications such as minimally invasive surgery. Path following performance is validated in a simulated laparoscopic scene and LEGO®-constructed scene, demonstrating significant improvement to feature tracking and robot motion, even under external forces.
- 17 January 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 4 (2) , 1194-1201
Vision-Based Online Learning Kinematic Control for Soft Robots Using Local Gaussian Process Regression
Soft robots, owing to their elastomeric material, ensure safe interaction with their surroundings. These robot compliance properties inevitably impose a trade-off against precise motion control, as to which conventional model-based methods were proposed to approximate the robot kinematics. However, too many parameters, regarding robot deformation and external disturbance, are difficult to obtain, even if possible, which could be very nonlinear. Sensors self-contained in the robot are required to compensate modelling uncertainties and external disturbances. Camera (eye) integrated at the robot end-effector (hand) is a common setting. To this end, we propose an eye-in-hand visual servo that incorporates with learning-based controller to accomplish more precise robotic tasks. Local Gaussian process regression (GPR) is used to initialize and refine the inverse mappings online, without prior knowledge of robot and camera parameters. Experimental validation is also conducted to demonstrate the hyper-elastic low-stiffness robot can compensate an external variable loading during trajectory tracking.
- 17 January 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 4 (2) , 1194-1201
Vision-Based Online Learning Kinematic Control for Soft Robots Using Local Gaussian Process Regression
Soft robots, owing to their elastomeric material, ensure safe interaction with their surroundings. These robot compliance properties inevitably impose a trade-off against precise motion control, as to which conventional model-based methods were proposed to approximate the robot kinematics. However, too many parameters, regarding robot deformation and external disturbance, are difficult to obtain, even if possible, which could be very nonlinear. Sensors self-contained in the robot are required to compensate modelling uncertainties and external disturbances. Camera (eye) integrated at the robot end-effector (hand) is a common setting. To this end, we propose an eye-in-hand visual servo that incorporates with learning-based controller to accomplish more precise robotic tasks. Local Gaussian process regression (GPR) is used to initialize and refine the inverse mappings online, without prior knowledge of robot and camera parameters. Experimental validation is also conducted to demonstrate the hyper-elastic low-stiffness robot can compensate an external variable loading during trajectory tracking.
- 14 January 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 4 (2) , 1454-1461
Real-Time Surface Shape Sensing for Soft and Flexible Structures Using Fiber Bragg Gratings
In this paper, we present a new soft and flexible sensor which can reconstruct its surface shape in real-time. A single-core optical fiber with fiber Bragg gratings (FBGs) is capable of detecting sparse local strains at high bandwidth using wavelength-division multiplexing (WDM). The fiber was embedded into an elastomeric substrate to reconstruct its global surface morphology. Finite element analysis (FEA) was used to determine the design parameters, and also to validate the unique mapping from sparse strain measurements to the continuum shape of the sensor. To simplify the fabrication and error compensation process without precise/prior knowledge of the FBG locations in the sensor, machine learning-based modelling was applied. This enables real-time, robust and reliable shape reconstruction. It is demonstrated to outperform various applications of electronics-based sensors which require sophisticated electrode wiring and noise reduction. Experiments were performed to evaluate the sensing accuracy and repeatability.
- 14 January 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 4 (2) , 1454-1461
Real-Time Surface Shape Sensing for Soft and Flexible Structures Using Fiber Bragg Gratings
In this paper, we present a new soft and flexible sensor which can reconstruct its surface shape in real-time. A single-core optical fiber with fiber Bragg gratings (FBGs) is capable of detecting sparse local strains at high bandwidth using wavelength-division multiplexing (WDM). The fiber was embedded into an elastomeric substrate to reconstruct its global surface morphology. Finite element analysis (FEA) was used to determine the design parameters, and also to validate the unique mapping from sparse strain measurements to the continuum shape of the sensor. To simplify the fabrication and error compensation process without precise/prior knowledge of the FBG locations in the sensor, machine learning-based modelling was applied. This enables real-time, robust and reliable shape reconstruction. It is demonstrated to outperform various applications of electronics-based sensors which require sophisticated electrode wiring and noise reduction. Experiments were performed to evaluate the sensing accuracy and repeatability.