Ling Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Ling Li has a total of 42 co-authors. Here are the top co-authors by number of shared publications:
- Xiaojian Li
School of Management, Hefei University of Technology, Hefei, China
7 shared publications - Shanlin Yang
Hefei University of Technology
5 shared publications - Hangjie Mo
School of Management, Hefei University of Technology, Hefei, China
3 shared publications - Shuai Ding
Hefei University of Technology
3 shared publications Xiaojian Li
School of Management, the Key Laboratory of Process Optimization and Intelligent Decision-Making, and the Data Science and Smart Society Governance Laboratory, Hefei University of Technology, Hefei, China
3 shared publicationsHangjie Mo
School of Management and the Key Laboratory of Process Optimization and Intelligent Decision-Making (Ministry of Education), Hefei University of Technology, Hefei, China
2 shared publications
Latest Publications
- 1 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 45 (4) , 1325-1336
Overlap-Aware Online-Adaptive Non-Rigid Registration of Intraoperative Tissue in Minimally Invasive Surgery
Non-rigid registration of intraoperative tissue is essential for surgical navigation and scene reconstruction in minimally invasive surgery. However, accurate registration remains challenging due to significant tissue deformation and partial overlaps caused by laparoscope movement. We propose an Overlap-Aware Online-Adaptive Non-Rigid Registration Method (OANRM) to address these challenges. The framework introduces a Hierarchical Matching Network (HMNet) that simultaneously predicts overlapping regions and their correspondences through a novel similarity-based approach. Our method uniquely incorporates an online adaptation mechanism that continuously fine-tunes the network parameters using unsupervised losses, enabling robust performance across varying surgical scenarios without requiring additional training data. A Transform Displacement Deformation Prediction (TDDP) module further enhances the framework by handling non-overlapping regions through integrating Random Sample Consensus with distance-based interpolation. The method is validated on both artificial datasets with controlled deformations and clinical datasets from real surgical procedures. Experimental results demonstrate that OANRM achieves state-of-the-art performance, significantly outperforming existing methods in handling complex tissue deformations and varying overlap ratios. https://github.com/AIGCer0807/OANRM.
- 1 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 45 (4) , 1325-1336
Overlap-Aware Online-Adaptive Non-Rigid Registration of Intraoperative Tissue in Minimally Invasive Surgery
Non-rigid registration of intraoperative tissue is essential for surgical navigation and scene reconstruction in minimally invasive surgery. However, accurate registration remains challenging due to significant tissue deformation and partial overlaps caused by laparoscope movement. We propose an Overlap-Aware Online-Adaptive Non-Rigid Registration Method (OANRM) to address these challenges. The framework introduces a Hierarchical Matching Network (HMNet) that simultaneously predicts overlapping regions and their correspondences through a novel similarity-based approach. Our method uniquely incorporates an online adaptation mechanism that continuously fine-tunes the network parameters using unsupervised losses, enabling robust performance across varying surgical scenarios without requiring additional training data. A Transform Displacement Deformation Prediction (TDDP) module further enhances the framework by handling non-overlapping regions through integrating Random Sample Consensus with distance-based interpolation. The method is validated on both artificial datasets with controlled deformations and clinical datasets from real surgical procedures. Experimental results demonstrate that OANRM achieves state-of-the-art performance, significantly outperforming existing methods in handling complex tissue deformations and varying overlap ratios. https://github.com/AIGCer0807/OANRM.
- 3 July 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 55 (10) , 6545-6557
Enhancing Robotic Surgery With Haptic Feedback: A Cooperative Control Strategy for Autonomous Laparoscope Control
The development of autonomous laparoscope control in robot-assisted surgery has emerged as a significant research area, particularly due to its potential to reduce assistant fatigue and minimize miscommunication between the surgeon and assistant. A notable challenge, however, is the tendency of autonomous control strategies to override the surgeon’s direct command occasionally. To address this issue, we propose a novel haptic feedback-based cooperative control strategy that enhances the surgeon’s command of laparoscopic field of view (FOV) movement in robot-assisted laparoscopic surgery. Specifically, we first established a dynamic model of the laparoscope-holding robot, which serves as a link between the movement of the laparoscopic FOV and the surgical instruments to deliver haptic feedback to the surgeon. Next, a motion observer was developed to transform 30 Hz visual feedback into 1 kHz haptic feedback by integrating visual tracking data with kinematic information, ensuring smoother and more continuous haptic feedback. Finally, we propose two distinct collaboration modes: the plane tracking mode (PTM) ensures instruments remain within the laparoscopic image, and the space tracking mode (STM) synchronizes the laparoscope with instrument movement. The laboratory experiments validated the effectiveness of the proposed method in enhancing the cooperative performance of robot-assisted laparoscope systems while animal experiments demonstrated the feasibility of the PTM design.
- 3 July 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 55 (10) , 6545-6557
Enhancing Robotic Surgery With Haptic Feedback: A Cooperative Control Strategy for Autonomous Laparoscope Control
The development of autonomous laparoscope control in robot-assisted surgery has emerged as a significant research area, particularly due to its potential to reduce assistant fatigue and minimize miscommunication between the surgeon and assistant. A notable challenge, however, is the tendency of autonomous control strategies to override the surgeon’s direct command occasionally. To address this issue, we propose a novel haptic feedback-based cooperative control strategy that enhances the surgeon’s command of laparoscopic field of view (FOV) movement in robot-assisted laparoscopic surgery. Specifically, we first established a dynamic model of the laparoscope-holding robot, which serves as a link between the movement of the laparoscopic FOV and the surgical instruments to deliver haptic feedback to the surgeon. Next, a motion observer was developed to transform 30 Hz visual feedback into 1 kHz haptic feedback by integrating visual tracking data with kinematic information, ensuring smoother and more continuous haptic feedback. Finally, we propose two distinct collaboration modes: the plane tracking mode (PTM) ensures instruments remain within the laparoscopic image, and the space tracking mode (STM) synchronizes the laparoscope with instrument movement. The laboratory experiments validated the effectiveness of the proposed method in enhancing the cooperative performance of robot-assisted laparoscope systems while animal experiments demonstrated the feasibility of the PTM design.
- 23 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 15990-16000
A Safety-Enhanced Multi-Modal Objectives Motion Fusion Method for Autonomous Retraction in Robotic Surgery
In minimally invasive surgery (MIS), tissue retraction is critical for exposing the surgical site and facilitating pathological tissue excision. However, tissue retraction in MIS is subject to multiple constraints, including restricted field of view, non-damaging tissue retraction force, and limited instrument operating range, which hinder the safe and continuous retraction of tissue during robotic-assisted surgery. This paper introduces a novel autonomous retraction method for MIS, capable of safely retracting tissue within the aforementioned multiple constraints, assisting the surgeon in tissue excision. The method takes into account information from three different modalities: vision, force, and position. Based on these, three distinct control objectives are defined: retraction angle, retraction force, and safety space constraints, with an individual controller and model-predictive evaluation function designed for each objective. We propose a novel multi-objective motion fusion strategy designed to balance three distinct control objectives. This strategy evaluates the sensitivity of each objective to changes in the system state by comparing the gradients of their respective prediction evaluation functions and fuses the control inputs of the individual controllers. The proposed method allows for rapid addition or removal of objectives without altering the algorithmic framework. Experiments with phantoms and ex vivo animal tissue are conducted on robotic platform to validate the effectiveness of the proposed method in various configurations. Note to Practitioners—The motivation of this study is to address the challenge of autonomous tissue retraction in robotic-assisted laparoscopic surgery under multiple constraints. Existing methods primarily focus on single objectives and overlook the conflicts and coordination required among multi-modal objectives such as retraction angle, force, and safety space constraints. These limitations reduce the safety of robotic systems in complex surgical scenarios. A safety-enhanced multi-modal objective fusion method was proposed, integrating vision, force, and position information through dynamic weight allocation based on model-predictive mechanism. The method allows flexible addition or removal of control objectives and constraints, ensuring robust performance in varying conditions. This work provides a practical solution to improve the safety of autonomous robotic retraction, offering valuable insights for practitioners aiming to enhance robotic systems in constrained environments.
- 23 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 15990-16000
A Safety-Enhanced Multi-Modal Objectives Motion Fusion Method for Autonomous Retraction in Robotic Surgery
In minimally invasive surgery (MIS), tissue retraction is critical for exposing the surgical site and facilitating pathological tissue excision. However, tissue retraction in MIS is subject to multiple constraints, including restricted field of view, non-damaging tissue retraction force, and limited instrument operating range, which hinder the safe and continuous retraction of tissue during robotic-assisted surgery. This paper introduces a novel autonomous retraction method for MIS, capable of safely retracting tissue within the aforementioned multiple constraints, assisting the surgeon in tissue excision. The method takes into account information from three different modalities: vision, force, and position. Based on these, three distinct control objectives are defined: retraction angle, retraction force, and safety space constraints, with an individual controller and model-predictive evaluation function designed for each objective. We propose a novel multi-objective motion fusion strategy designed to balance three distinct control objectives. This strategy evaluates the sensitivity of each objective to changes in the system state by comparing the gradients of their respective prediction evaluation functions and fuses the control inputs of the individual controllers. The proposed method allows for rapid addition or removal of objectives without altering the algorithmic framework. Experiments with phantoms and ex vivo animal tissue are conducted on robotic platform to validate the effectiveness of the proposed method in various configurations. Note to Practitioners—The motivation of this study is to address the challenge of autonomous tissue retraction in robotic-assisted laparoscopic surgery under multiple constraints. Existing methods primarily focus on single objectives and overlook the conflicts and coordination required among multi-modal objectives such as retraction angle, force, and safety space constraints. These limitations reduce the safety of robotic systems in complex surgical scenarios. A safety-enhanced multi-modal objective fusion method was proposed, integrating vision, force, and position information through dynamic weight allocation based on model-predictive mechanism. The method allows flexible addition or removal of control objectives and constraints, ensuring robust performance in varying conditions. This work provides a practical solution to improve the safety of autonomous robotic retraction, offering valuable insights for practitioners aiming to enhance robotic systems in constrained environments.
- Open Access
- 29 January 2025
- Published by Elsevier in EngMedicine
- Vol. 2 (1)
Smart surgical telementoring system with patch-to-pixel point tracking method
- 29 January 2025
- Published by Elsevier in EngMedicine
- Vol. 2 (1)
Open AccessSmart surgical telementoring system with patch-to-pixel point tracking method
- Open Access
- 9 August 2024
- Published by Association for Computing Machinery (ACM)
- p. 731-737
Automated Cross-modal Registration Algorithm For Liver Surgery Navigation
- 9 August 2024
- Published by Association for Computing Machinery (ACM)
- p. 731-737
Open AccessAutomated Cross-modal Registration Algorithm For Liver Surgery Navigation
- 5 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 73 (00189456) , 1-13
Real-Time and High-Accuracy Switchable Stereo Depth Estimation Method Utilizing Self-Supervised Online Learning Mechanism for MIS
In minimally invasive surgery (MIS), clinicians often rely on 2-D laparoscopic images to assess the size and distances between internal structures. However, this subjective estimation introduces significant uncertainty and can increase surgical risks while reducing efficiency. Modern 3-D laparoscopes offer improved stereoscopic perception and can incorporate stereo depth estimation methods for quantitative analysis. However, existing methods struggle with real-time and high-accuracy demands in diverse surgical scenarios. To address this issue, we propose a novel intraoperative stereo depth estimation framework termed metainitialized online learning (MIOL), aiming to assist surgeons in quantitatively controlling surgical targets during the procedure. This framework features two switchable modes and does not require annotated data. One mode enables rapid depth recovery through surgical videos, providing real-time 3-D reconstruction to help surgeons understand in vivo structures. The other mode achieves high-precision measurements of critical tissues in fixed frames, assisting in surgical decision-making. Our approach employs self-supervised adaptation to train a model specific to each stereo image, eliminating the need for generalization and achieving outstanding accuracy. The framework establishes a lightweight network that converges rapidly under self-supervised losses and incorporates meta-learning pretraining, sparse optical flow guidance, and effective region identification to ensure speed and accuracy. Extensive experiments on two public datasets demonstrate the superiority of our method over existing approaches. Furthermore, we implement an intraoperative measurement system and conduct clinical trials, confirming its practical utility. The code is available at https://github.com/Darcy-vision/MIOL .
- 5 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 73 (00189456) , 1-13
Real-Time and High-Accuracy Switchable Stereo Depth Estimation Method Utilizing Self-Supervised Online Learning Mechanism for MIS
In minimally invasive surgery (MIS), clinicians often rely on 2-D laparoscopic images to assess the size and distances between internal structures. However, this subjective estimation introduces significant uncertainty and can increase surgical risks while reducing efficiency. Modern 3-D laparoscopes offer improved stereoscopic perception and can incorporate stereo depth estimation methods for quantitative analysis. However, existing methods struggle with real-time and high-accuracy demands in diverse surgical scenarios. To address this issue, we propose a novel intraoperative stereo depth estimation framework termed metainitialized online learning (MIOL), aiming to assist surgeons in quantitatively controlling surgical targets during the procedure. This framework features two switchable modes and does not require annotated data. One mode enables rapid depth recovery through surgical videos, providing real-time 3-D reconstruction to help surgeons understand in vivo structures. The other mode achieves high-precision measurements of critical tissues in fixed frames, assisting in surgical decision-making. Our approach employs self-supervised adaptation to train a model specific to each stereo image, eliminating the need for generalization and achieving outstanding accuracy. The framework establishes a lightweight network that converges rapidly under self-supervised losses and incorporates meta-learning pretraining, sparse optical flow guidance, and effective region identification to ensure speed and accuracy. Extensive experiments on two public datasets demonstrate the superiority of our method over existing approaches. Furthermore, we implement an intraoperative measurement system and conduct clinical trials, confirming its practical utility. The code is available at https://github.com/Darcy-vision/MIOL .
- Open Access
- 1 January 2023
- Published by American Association for the Advancement of Science (AAAS) in Cyborg and Bionic Systems
- Vol. 4, 0042
Three-Dimensional Collision Avoidance Method for Robot-Assisted Minimally Invasive Surgery
In the robot-assisted minimally invasive surgery, if a collision occurs, the robot system program could be damaged, and normal tissues could be injured. To avoid collisions during surgery, a 3-dimensional collision avoidance method is proposed in this paper. The proposed method is predicated on the design of 3 strategic vectors: the collision-with-instrument-avoidance (CI) vector, the collision-with-tissues-avoidance (CT) vector, and the constrained-control (CC) vector. The CI vector demarcates 3 specific directions to forestall collision among the surgical instruments. The CT vector, on the other hand, comprises 2 components tailored to prevent inadvertent contact between the robot-controlled instrument and nontarget tissues. Meanwhile, the CC vector is introduced to guide the endpoint of the robot-controlled instrument toward the desired position, ensuring precision in its movements, in alignment with the surgical goals. Simulation results verify the proposed collision avoidance method for robot-assisted minimally invasive surgery. The code and data are available athttps://github.com/cynerelee/collision-avoidance.
- 1 January 2023
- Published by American Association for the Advancement of Science (AAAS) in Cyborg and Bionic Systems
- Vol. 4, 0042
Open AccessThree-Dimensional Collision Avoidance Method for Robot-Assisted Minimally Invasive Surgery
In the robot-assisted minimally invasive surgery, if a collision occurs, the robot system program could be damaged, and normal tissues could be injured. To avoid collisions during surgery, a 3-dimensional collision avoidance method is proposed in this paper. The proposed method is predicated on the design of 3 strategic vectors: the collision-with-instrument-avoidance (CI) vector, the collision-with-tissues-avoidance (CT) vector, and the constrained-control (CC) vector. The CI vector demarcates 3 specific directions to forestall collision among the surgical instruments. The CT vector, on the other hand, comprises 2 components tailored to prevent inadvertent contact between the robot-controlled instrument and nontarget tissues. Meanwhile, the CC vector is introduced to guide the endpoint of the robot-controlled instrument toward the desired position, ensuring precision in its movements, in alignment with the surgical goals. Simulation results verify the proposed collision avoidance method for robot-assisted minimally invasive surgery. The code and data are available athttps://github.com/cynerelee/collision-avoidance.
- 7 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (2) , 4212-4219
SIRNet: Fine-Grained Surgical Interaction Recognition
Surgical interaction recognition (SIR) plays a crucial role in navigation decision support for minimally invasive surgery (MIS) or robot-assisted MIS. Currently, the research in SIR is at a coarse-grained level and barely considers the surgical interaction dependencies unrelated to endoscopic images. This work proposes a fine-grained SIR method named SIRNet aiming at predicting surgical interaction triplets. In the proposed SIRNet, a multi-head self-attention mechanism learns the relations among surgical interaction triplets without defining them before the training process, while a multi-head cross-attention mechanism learns the relationships between the endoscopic images and each triplet. The bipartite matching loss, which considers the permutation and combination of instruments, verbs, and targets, is adopted to make appropriate learning and prediction for each component in the surgical interaction triplet. Moreover, a weight attention module is designed to weigh the importance of each predicted surgical interaction triplet and each component in triplet when predicting final valid surgical interaction triplets. The experimental results show the proposed method improves the performance of fine-grained SIR. In addition, experiments also present the effectiveness of each module. The code is available at https://github.com/cynerelee/SIRNet https://github.com/cynerelee/SIRNet .
- 7 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (2) , 4212-4219
SIRNet: Fine-Grained Surgical Interaction Recognition
Surgical interaction recognition (SIR) plays a crucial role in navigation decision support for minimally invasive surgery (MIS) or robot-assisted MIS. Currently, the research in SIR is at a coarse-grained level and barely considers the surgical interaction dependencies unrelated to endoscopic images. This work proposes a fine-grained SIR method named SIRNet aiming at predicting surgical interaction triplets. In the proposed SIRNet, a multi-head self-attention mechanism learns the relations among surgical interaction triplets without defining them before the training process, while a multi-head cross-attention mechanism learns the relationships between the endoscopic images and each triplet. The bipartite matching loss, which considers the permutation and combination of instruments, verbs, and targets, is adopted to make appropriate learning and prediction for each component in the surgical interaction triplet. Moreover, a weight attention module is designed to weigh the importance of each predicted surgical interaction triplet and each component in triplet when predicting final valid surgical interaction triplets. The experimental results show the proposed method improves the performance of fine-grained SIR. In addition, experiments also present the effectiveness of each module. The code is available at https://github.com/cynerelee/SIRNet https://github.com/cynerelee/SIRNet .
- 1 December 2021
- Published by Elsevier in Knowledge-Based Systems
- Vol. 233
Referent graph embedding model for name entity recognition of Chinese car reviews
- 1 December 2021
- Published by Elsevier in Knowledge-Based Systems
- Vol. 233
Referent graph embedding model for name entity recognition of Chinese car reviews
- 2 April 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 27 (2) , 733-743
Autonomous Multiple Instruments Tracking for Robot-Assisted Laparoscopic Surgery With Visual Tracking Space Vector Method
The robot-held laparoscope efficiently maintains the stability of the surgical screen in comparison with the laparoscope held by the assistant. The collaboration between the robot-held laparoscope and the surgeon is achieved without the artificial manipulation by tracking surgical instruments automatically. In this article, a visual tracking space vector method is proposed to autonomously control the field of view by tracking multiple surgical instruments. In the proposed method, a visual tracking space vector is introduced to track the motion of multiple instruments, and a constraint vector is defined to ensure that the laparoscope is always within the safe working space. In addition, a modified YOLOv3 algorithm is proposed to robustly detect and classify the surgical instruments. The proposed method automatically adapts to the changes in the number of surgical instruments, as compared to other visual servoing methods for tracking surgical instruments. The proposed method does not require the depth information of the tracked surgical instruments. Experimental and simulation results verify that the proposed method accurately and efficiently controls the robot-held laparoscope to track the motion of multiple surgical instruments and ensure safe tracking movement.
- 2 April 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 27 (2) , 733-743
Autonomous Multiple Instruments Tracking for Robot-Assisted Laparoscopic Surgery With Visual Tracking Space Vector Method
The robot-held laparoscope efficiently maintains the stability of the surgical screen in comparison with the laparoscope held by the assistant. The collaboration between the robot-held laparoscope and the surgeon is achieved without the artificial manipulation by tracking surgical instruments automatically. In this article, a visual tracking space vector method is proposed to autonomously control the field of view by tracking multiple surgical instruments. In the proposed method, a visual tracking space vector is introduced to track the motion of multiple instruments, and a constraint vector is defined to ensure that the laparoscope is always within the safe working space. In addition, a modified YOLOv3 algorithm is proposed to robustly detect and classify the surgical instruments. The proposed method automatically adapts to the changes in the number of surgical instruments, as compared to other visual servoing methods for tracking surgical instruments. The proposed method does not require the depth information of the tracked surgical instruments. Experimental and simulation results verify that the proposed method accurately and efficiently controls the robot-held laparoscope to track the motion of multiple surgical instruments and ensure safe tracking movement.