KWKui Wang

Kui Wang

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Kui Wang has a total of 47 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    A Fast Soft Robotic Laser Sweeping System Using Data-Driven Modeling Approach

    by Kui Wang, Xiaomei Wang, Justin Di-Lang Ho, Ge Fang, Bohao Zhu, Rongying Xie, Yun-Hui Liu, Kwok Wai Samuel Au, Jason Ying-Kuen Chan, Ka-Wai Kwok

    Soft robots have great potential in surgical applications due to their compliance and adaptability to their environment. However, their flexibility and nonlinearity bring challenges for precise modeling, sensing, and control, especially in constrained cavities. In this article, a simple, compact two-segment soft robot for flexible laser ablation is proposed. The proximal hydraulic-driven segment can offer omnidirectional bending so as to navigate toward lesions. The distal segment driven by tendons enables precise, fast steering of laser collimator for laser sweeping on lesion targets. The dynamics of such mechanical steering motion can be enhanced with a metal spring backbone integrated along the collimator, thus facilitating the control with certain linearity and responsiveness. A soft robot modeling and control scheme based on Koopman operators is proposed. We also design a disturbance observer so as to incorporate the controller feedback with real-time fiber optic shape sensing. Experimental validation is conducted on simulated or ex-vivo laser ablation tasks, thus evaluating our control strategies in laser path following across various contours/patterns. As a result, such a simple compact laser manipulation can perform up to 6 Hz sweeping with precision of path following errors below 1 mm. Such modeling and control scheme could also be used on an endoscopic laser ablation robot with unsymmetric mechanism driven by two tendons.


  • Open Access

    Learning-Based Visual-Strain Fusion for Eye-in-Hand Continuum Robot Pose Estimation and Control

    by Xiaomei Wang, Jing Dai, Hon-Sing Tong, Kui Wang, Ge Fang, Xiaochen Xie, Yun-Hui Liu, Kwok Wai Samuel Au, Ka-Wai Kwok

    Image processing has significantly extended the practical value of the eye-in-hand camera, enabling and promoting its applications for quantitative measurement. However, fully vision-based pose estimation methods sometimes encounter difficulties in handling cases with deficient features. In this article, we fuse visual information with the sparse strain data collected from a single-core fiber inscribed with fiber Bragg gratings (FBGs) to facilitate continuum robot pose estimation. An improved extreme learning machine algorithm with selective training data updates is implemented to establish and refine the FBG-empowered (F-emp) pose estimator online . The integration of F-emp pose estimation can improve sensing robustness by reducing the number of times that visual tracking is lost given moving visual obstacles and varying lighting. In particular, this integration solves pose estimation failures under full occlusion of the tracked features or complete darkness. Utilizing the fused pose feedback, a hybrid controller incorporating kinematics and data-driven algorithms is proposed to accomplish fast convergence with high accuracy. The online-learning error compensator can improve the target tracking performance with a 52.3%–90.1% error reduction compared with constant-curvature model-based control, without requiring fine model-parameter tuning and prior data acquisition.


  • Open Access

    Supporting Information for "Intelligent Shape Decoding of a Soft Optical Waveguide Sensor"

    by Chi Hin Mak, Yingqi Li, Kui Wang, Mengjie Wu, Justin Di-Lang Ho, Qi Dou, Kam-Yim Sze, Kaspar Althoefer, Ka-Wai Kwok

    Figure S1. (A) LED & PD placement of the fish-shaped waveguide sensor. (B) Sandwiched PDMS structure of the soft waveguide sensor, where opaque and semi-opaque layers are silicone-dyed to enable internal reflection.

  • Open Access

    Large‐Scale Surface Shape Sensing with Learning‐Based Computational Mechanics

    by Kui Wang, Chi‐Hin Mak, Justin D. L. Ho, Zhiyu Liu, Kam‐Yim Sze, Kenneth K. Y. Wong, Kaspar Althoefer, Yunhui Liu, Toshio Fukuda, Ka-Wai Kwok

    Proprioception, the ability to perceive one's own configuration and movement in space, enables organisms to safely and accurately interact with their environment and each other. The underlying sensory nerves that make this possible are highly dense and use sophisticated communication pathways to propagate signals from nerves in muscle, skin, and joints to the central nervous system wherein the organism can process and react to stimuli. In a step forward to realize robots with such perceptive capability, a flexible sensor framework that incorporates a novel modeling strategy, taking advantage of computational mechanics and machine learning, is proposed. The sensor framework on a large flexible sensor that transforms sparsely distributed strains into continuous surface is implemented. Finite element (FE) analysis is utilized to determine design parameters, while an FE model is built to enrich the morphological data used in the supervised training to achieve continuous surface reconstruction. A mapping between the local strain data and the enriched surface data is subsequently trained using ensemble learning. This hybrid approach enables real time, robust, and high‐order surface reconstruction. The sensing performance is evaluated in terms of accuracy, repeatability, and feasibility with numerous scenarios, which has not been demonstrated on such a large‐scale sensor before.


  • Soft robotic manipulator for intraoperative MRI-guided transoral laser microsurgery

    by Ge Fang, Marco C. K. Chow, Justin D. L. Ho, Zhuoliang He, Kui Wang, T. C. Ng, James K. H. Tsoi, Po-Ling Chan, Hing-Chiu Chang, Danny Tat-Ming Chan, et al.

    A compact and dexterous magnetic resonance (MR)–safe soft robot enables MR imaging–guided transoral laser microsurgery.


  • Open Access

    Supporting Information for "Large-scale Surface Shape Sensing with Learning-based Computational Mechanics"

    by Kui Wang, Chi Hin Mak, Justin Di-Lang Ho, Zhi-Yu Liu, Kam Yim Sze, Kenneth K.Y. Wong, Kaspar Althoefer, Yunhui Liu, Toshiko Fukuda, Ka-Wai Kwok

    Proprioception, the ability to perceive one’s own configuration and movement in space, enables organisms to safely and accurately interact with their environment and each other. The underlying sensory nerves that make this possible are highly dense and use sophisticated communication pathways to propagate signals from nerves in muscle, skin and joints to the central nervous system wherein the organism can process and react to stimuli. In a step forward to realize robots with such perceptive capability, we propose a flexible sensor framework that incorporates a novel hybrid modeling strategy, taking advantage of computational mechanics and machine learning. We implement the sensor framework on a large, thin and flexible sensor that transforms sparsely distributed strains into continuous surface shape. Finite element (FE) analysis is utilized to determine sensor design parameters, while an FE model is built to enrich the morphological data used in the supervised training to achieve continuous surface reconstruction. A mapping between the local strain data and the enriched surface data is subsequently trained using ensemble learning. This hybrid approach enables real-time, robust and high-order surface shape reconstruction. The sensing performance is evaluated in terms of accuracy, repeatability, and feasibility with numerous scenarios, which has not been demonstrated and reported on such a large-scale (A4-paper-size) sensor before.

  • Eye-in-Hand Visual Servoing Enhanced With Sparse Strain Measurement for Soft Continuum Robots

    by Xiaomei Wang, Ge Fang, Kui Wang, Xiaochen Xie, Kit-Hang Lee, Justin Di-Lang Ho, Wai Lun Tang, James Lam, Ka-Wai Kwok

    In the feature/object tracking of eye-in-hand visual servoing, 2D motion estimation relying only on image plane feedback is easily affected by vision occlusion, blurring, or poor lighting. For the commonly-used template matching method, tracking performance greatly depends on the image quality. Fiber Bragg gratings (FBGs), a type of high-frequency flexible strain sensor, can be used as an assistant device for soft robot control. We propose a method to enhance motion estimation in soft robotic visual servoing by fusing the results from template matching and FBG wavelength shifts to achieve more accurate tracking in applications such as minimally invasive surgery. Path following performance is validated in a simulated laparoscopic scene and LEGO®-constructed scene, demonstrating significant improvement to feature tracking and robot motion, even under external forces.


  • Vision-Based Online Learning Kinematic Control for Soft Robots Using Local Gaussian Process Regression

    by Ge Fang, Xiaomei Wang, Kui Wang, Kit-Hang Lee, Justin Di-Lang Ho, Hing-Choi Fu, Denny Kin Chung Fu, Ka-Wai Kwok

    Soft robots, owing to their elastomeric material, ensure safe interaction with their surroundings. These robot compliance properties inevitably impose a trade-off against precise motion control, as to which conventional model-based methods were proposed to approximate the robot kinematics. However, too many parameters, regarding robot deformation and external disturbance, are difficult to obtain, even if possible, which could be very nonlinear. Sensors self-contained in the robot are required to compensate modelling uncertainties and external disturbances. Camera (eye) integrated at the robot end-effector (hand) is a common setting. To this end, we propose an eye-in-hand visual servo that incorporates with learning-based controller to accomplish more precise robotic tasks. Local Gaussian process regression (GPR) is used to initialize and refine the inverse mappings online, without prior knowledge of robot and camera parameters. Experimental validation is also conducted to demonstrate the hyper-elastic low-stiffness robot can compensate an external variable loading during trajectory tracking.


  • Real-Time Surface Shape Sensing for Soft and Flexible Structures Using Fiber Bragg Gratings

    by Tian Le Tim Lun, Kui Wang, Justin Di-Lang Ho, Kit-Hang Lee, Kam Yim Sze, Ka-Wai Kwok

    In this paper, we present a new soft and flexible sensor which can reconstruct its surface shape in real-time. A single-core optical fiber with fiber Bragg gratings (FBGs) is capable of detecting sparse local strains at high bandwidth using wavelength-division multiplexing (WDM). The fiber was embedded into an elastomeric substrate to reconstruct its global surface morphology. Finite element analysis (FEA) was used to determine the design parameters, and also to validate the unique mapping from sparse strain measurements to the continuum shape of the sensor. To simplify the fabrication and error compensation process without precise/prior knowledge of the FBG locations in the sensor, machine learning-based modelling was applied. This enables real-time, robust and reliable shape reconstruction. It is demonstrated to outperform various applications of electronics-based sensors which require sophisticated electrode wiring and noise reduction. Experiments were performed to evaluate the sensing accuracy and repeatability.