LLLing Li

Ling Li

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Ling Li has a total of 42 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Overlap-Aware Online-Adaptive Non-Rigid Registration of Intraoperative Tissue in Minimally Invasive Surgery

    by Hangjie Mo, Weizhao Cheng, Ziming Shen, Ruofeng Wei, Ling Li, Xiaojian Li, Shanlin Yang

    Non-rigid registration of intraoperative tissue is essential for surgical navigation and scene reconstruction in minimally invasive surgery. However, accurate registration remains challenging due to significant tissue deformation and partial overlaps caused by laparoscope movement. We propose an Overlap-Aware Online-Adaptive Non-Rigid Registration Method (OANRM) to address these challenges. The framework introduces a Hierarchical Matching Network (HMNet) that simultaneously predicts overlapping regions and their correspondences through a novel similarity-based approach. Our method uniquely incorporates an online adaptation mechanism that continuously fine-tunes the network parameters using unsupervised losses, enabling robust performance across varying surgical scenarios without requiring additional training data. A Transform Displacement Deformation Prediction (TDDP) module further enhances the framework by handling non-overlapping regions through integrating Random Sample Consensus with distance-based interpolation. The method is validated on both artificial datasets with controlled deformations and clinical datasets from real surgical procedures. Experimental results demonstrate that OANRM achieves state-of-the-art performance, significantly outperforming existing methods in handling complex tissue deformations and varying overlap ratios. https://github.com/AIGCer0807/OANRM.

  • Enhancing Robotic Surgery With Haptic Feedback: A Cooperative Control Strategy for Autonomous Laparoscope Control

    by Jin Fang, Xiaojian Li, Hangjie Mo, Hua Tang, Pengxin Guo, Kai Yan, Xinyue Li, Ling Li

    The development of autonomous laparoscope control in robot-assisted surgery has emerged as a significant research area, particularly due to its potential to reduce assistant fatigue and minimize miscommunication between the surgeon and assistant. A notable challenge, however, is the tendency of autonomous control strategies to override the surgeon’s direct command occasionally. To address this issue, we propose a novel haptic feedback-based cooperative control strategy that enhances the surgeon’s command of laparoscopic field of view (FOV) movement in robot-assisted laparoscopic surgery. Specifically, we first established a dynamic model of the laparoscope-holding robot, which serves as a link between the movement of the laparoscopic FOV and the surgical instruments to deliver haptic feedback to the surgeon. Next, a motion observer was developed to transform 30 Hz visual feedback into 1 kHz haptic feedback by integrating visual tracking data with kinematic information, ensuring smoother and more continuous haptic feedback. Finally, we propose two distinct collaboration modes: the plane tracking mode (PTM) ensures instruments remain within the laparoscopic image, and the space tracking mode (STM) synchronizes the laparoscope with instrument movement. The laboratory experiments validated the effectiveness of the proposed method in enhancing the cooperative performance of robot-assisted laparoscope systems while animal experiments demonstrated the feasibility of the PTM design.


  • A Safety-Enhanced Multi-Modal Objectives Motion Fusion Method for Autonomous Retraction in Robotic Surgery

    by Yudong Shi, Hangjie Mo, Xilin Xiao, Jin Fang, Ling Li, Kang Min, Xiaojian Li

    In minimally invasive surgery (MIS), tissue retraction is critical for exposing the surgical site and facilitating pathological tissue excision. However, tissue retraction in MIS is subject to multiple constraints, including restricted field of view, non-damaging tissue retraction force, and limited instrument operating range, which hinder the safe and continuous retraction of tissue during robotic-assisted surgery. This paper introduces a novel autonomous retraction method for MIS, capable of safely retracting tissue within the aforementioned multiple constraints, assisting the surgeon in tissue excision. The method takes into account information from three different modalities: vision, force, and position. Based on these, three distinct control objectives are defined: retraction angle, retraction force, and safety space constraints, with an individual controller and model-predictive evaluation function designed for each objective. We propose a novel multi-objective motion fusion strategy designed to balance three distinct control objectives. This strategy evaluates the sensitivity of each objective to changes in the system state by comparing the gradients of their respective prediction evaluation functions and fuses the control inputs of the individual controllers. The proposed method allows for rapid addition or removal of objectives without altering the algorithmic framework. Experiments with phantoms and ex vivo animal tissue are conducted on robotic platform to validate the effectiveness of the proposed method in various configurations. Note to Practitioners—The motivation of this study is to address the challenge of autonomous tissue retraction in robotic-assisted laparoscopic surgery under multiple constraints. Existing methods primarily focus on single objectives and overlook the conflicts and coordination required among multi-modal objectives such as retraction angle, force, and safety space constraints. These limitations reduce the safety of robotic systems in complex surgical scenarios. A safety-enhanced multi-modal objective fusion method was proposed, integrating vision, force, and position information through dynamic weight allocation based on model-predictive mechanism. The method allows flexible addition or removal of control objectives and constraints, ensuring robust performance in varying conditions. This work provides a practical solution to improve the safety of autonomous robotic retraction, offering valuable insights for practitioners aiming to enhance robotic systems in constrained environments.


  • Open Access

    Smart surgical telementoring system with patch-to-pixel point tracking method

    by Yanwei Qu, Ling Li, Tongtong Li, Jieyu Zheng, Wentao Tang, Xiaojian Li


  • Open Access

    Automated Cross-modal Registration Algorithm For Liver Surgery Navigation

    by Ling Li, Yulu Chen, Ziming Shen, Hangjie Mo, Xiaojian Li

  • Real-Time and High-Accuracy Switchable Stereo Depth Estimation Method Utilizing Self-Supervised Online Learning Mechanism for MIS

    by Jieyu Zheng, Xiaojian Li, Xin Wang, Haojun Wu, Ling Li, Xiang Ma, Shanlin Yang

    In minimally invasive surgery (MIS), clinicians often rely on 2-D laparoscopic images to assess the size and distances between internal structures. However, this subjective estimation introduces significant uncertainty and can increase surgical risks while reducing efficiency. Modern 3-D laparoscopes offer improved stereoscopic perception and can incorporate stereo depth estimation methods for quantitative analysis. However, existing methods struggle with real-time and high-accuracy demands in diverse surgical scenarios. To address this issue, we propose a novel intraoperative stereo depth estimation framework termed metainitialized online learning (MIOL), aiming to assist surgeons in quantitatively controlling surgical targets during the procedure. This framework features two switchable modes and does not require annotated data. One mode enables rapid depth recovery through surgical videos, providing real-time 3-D reconstruction to help surgeons understand in vivo structures. The other mode achieves high-precision measurements of critical tissues in fixed frames, assisting in surgical decision-making. Our approach employs self-supervised adaptation to train a model specific to each stereo image, eliminating the need for generalization and achieving outstanding accuracy. The framework establishes a lightweight network that converges rapidly under self-supervised losses and incorporates meta-learning pretraining, sparse optical flow guidance, and effective region identification to ensure speed and accuracy. Extensive experiments on two public datasets demonstrate the superiority of our method over existing approaches. Furthermore, we implement an intraoperative measurement system and conduct clinical trials, confirming its practical utility. The code is available at https://github.com/Darcy-vision/MIOL .


  • Open Access

    Three-Dimensional Collision Avoidance Method for Robot-Assisted Minimally Invasive Surgery

    by Ling Li, Xiaojian Li, Bo Ouyang, Hangjie Mo, Hongliang Ren, Shanlin Yang

    In the robot-assisted minimally invasive surgery, if a collision occurs, the robot system program could be damaged, and normal tissues could be injured. To avoid collisions during surgery, a 3-dimensional collision avoidance method is proposed in this paper. The proposed method is predicated on the design of 3 strategic vectors: the collision-with-instrument-avoidance (CI) vector, the collision-with-tissues-avoidance (CT) vector, and the constrained-control (CC) vector. The CI vector demarcates 3 specific directions to forestall collision among the surgical instruments. The CT vector, on the other hand, comprises 2 components tailored to prevent inadvertent contact between the robot-controlled instrument and nontarget tissues. Meanwhile, the CC vector is introduced to guide the endpoint of the robot-controlled instrument toward the desired position, ensuring precision in its movements, in alignment with the surgical goals. Simulation results verify the proposed collision avoidance method for robot-assisted minimally invasive surgery. The code and data are available athttps://github.com/cynerelee/collision-avoidance.


  • SIRNet: Fine-Grained Surgical Interaction Recognition

    by Ling Li, Xiaojian Li, Shuai Ding, Zhao Fang, Mengya Xu, Hongliang Ren, Shanlin Yang

    Surgical interaction recognition (SIR) plays a crucial role in navigation decision support for minimally invasive surgery (MIS) or robot-assisted MIS. Currently, the research in SIR is at a coarse-grained level and barely considers the surgical interaction dependencies unrelated to endoscopic images. This work proposes a fine-grained SIR method named SIRNet aiming at predicting surgical interaction triplets. In the proposed SIRNet, a multi-head self-attention mechanism learns the relations among surgical interaction triplets without defining them before the training process, while a multi-head cross-attention mechanism learns the relationships between the endoscopic images and each triplet. The bipartite matching loss, which considers the permutation and combination of instruments, verbs, and targets, is adopted to make appropriate learning and prediction for each component in the surgical interaction triplet. Moreover, a weight attention module is designed to weigh the importance of each predicted surgical interaction triplet and each component in triplet when predicting final valid surgical interaction triplets. The experimental results show the proposed method improves the performance of fine-grained SIR. In addition, experiments also present the effectiveness of each module. The code is available at https://github.com/cynerelee/SIRNet https://github.com/cynerelee/SIRNet .


  • Referent graph embedding model for name entity recognition of Chinese car reviews

    by Zhao Fang, Qiang Zhang, Stanley Kok, Ling Li, Anning Wang, Shanlin Yang


  • Autonomous Multiple Instruments Tracking for Robot-Assisted Laparoscopic Surgery With Visual Tracking Space Vector Method

    by Ling Li, Xiaojian Li, Bo Ouyang, Shuai Ding, Shanlin Yang, Yanwei Qu

    The robot-held laparoscope efficiently maintains the stability of the surgical screen in comparison with the laparoscope held by the assistant. The collaboration between the robot-held laparoscope and the surgeon is achieved without the artificial manipulation by tracking surgical instruments automatically. In this article, a visual tracking space vector method is proposed to autonomously control the field of view by tracking multiple surgical instruments. In the proposed method, a visual tracking space vector is introduced to track the motion of multiple instruments, and a constraint vector is defined to ensure that the laparoscope is always within the safe working space. In addition, a modified YOLOv3 algorithm is proposed to robustly detect and classify the surgical instruments. The proposed method automatically adapts to the changes in the number of surgical instruments, as compared to other visual servoing methods for tracking surgical instruments. The proposed method does not require the depth information of the tracked surgical instruments. Experimental and simulation results verify that the proposed method accurately and efficiently controls the robot-held laparoscope to track the motion of multiple surgical instruments and ensure safe tracking movement.