Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Junling Fu has a total of 36 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Learning-Based Adaptive Impedance Control Toward Safe Autonomous Transseptal Puncture

    by Anna Bicchi, Eleonora Pollini, Junling Fu, Federica Gramegna, Elena De Momi

    TransSeptal Puncture (TSP) is a key step in many minimally invasive cardiac procedures, enabling access to the left atrium by crossing the interatrial septum from the right atrium. The task demands extreme precision, as excessive force may cause cardiac tamponade. Robotic platforms can improve precision and repeatability, but most of the existing systems are designed for training or teleoperation rather than autonomous execution, and do not incorporate adaptive impedance modulation. This work presents a learning-from-demonstration framework based on probabilistic impedance modeling to investigate the feasibility of learning and embedding expert force-regulation strategies for autonomous execution of the TSP under clinician-defined targets. Specifically, Gaussian Mixture Models, trained on teleoperated demonstrations, capture the relationship between contact force and operator stiffness, enabling real-time modulation of impedance through Gaussian Mixture Regression. The adaptive controller was deployed on a 7-DoF robotic platform and validated on fossa ovalis phantoms of varying compliance and on ex vivo porcine tissue. Performance was evaluated using clinically relevant metrics: Needle Puncture Force (NPF), Tenting Distance (TD), and Needle Stopping Space (NSS). Compared to fixed-stiffness baselines, the proposed controller reduced NPF by up to 35%, maintained TD within safe limits, and limited NSS below 1 mm in nominal anatomies, with consistent performance also observed under extreme phantom anatomies and ex vivo tissue. These findings demonstrate that embedding human-like impedance modulation can enable safe, anatomy-aware autonomous control, advancing robotic TSP toward clinical feasibility.


  • Open Access

    Learning-Based Hybrid Needle Tip Tracking and Visualization Framework for Robotic Ultrasound-Guided Interventions

    by Junling Fu, Zijian Cai, Runing Xiao, Giancarlo Ferrigno, Alberto Redaelli, Elena De Momi

    Ultrasound (US)-guided needle-based interventions have been extensively employed in clinical practice for biopsies, regional anesthesia, and tumor ablation, considering the advantages of real-time imaging, portability, and non-ionizing radiation. Precise localization and tracking of the needle tip are critical for ensuring the successful needle placement while minimizing the risk of injury to surrounding anatomical structures. However, achieving real-time and reliable needle tip tracking remains challenging due to the inherent properties of US images, such as low spatial resolution, speckle noise, and imaging artifacts that obscure the needle tip. This study proposes a hybrid learning-based framework for accurately and robustly localizing the needle tip within the US image plane during robot-assisted interventional procedures. The framework comprises a dual-branch template matching-based detection module, a Convolutional Neural Network (CNN)-based detection module, and a “dynamic template selection and updating" mechanism to enhance overall tracking performance. Additionally, to recover the needle tip invisibility caused by unanticipated movements, an active exploration strategy based on a Gaussian Process (GP) model and Bayesian Optimization (BO) is proposed for efficient and accurate robotic US probe pose adjustment. The effectiveness of the proposed method for needle tip tracking performance has been evaluated through a series of experiments conducted on ex vivo porcine liver samples under varying insertion angles and velocities. Experimental results demonstrate that the proposed framework achieves a maximum median localization error of 1.17 mm and an Interquartile Range (IQR) of 1.28 mm across all test conditions. Furthermore, in scenarios requiring needle tip visibility recovery, the proposed BO-based strategy achieved a median localization error of 1.52 mm and an IQR of 0.95 mm.


  • Open Access

    Visuo-Haptic Feedback and Extended Reality in Microinvasive Cardiac Surgery: A Next-Generation Simulator for Mitral Valve Repair

    by Sofia Breschi, Domenico Riggio, Ingrid Tombini, Junling Fu, Maria Francesca Spadea, Elena De Momi

    Mitral regurgitation is a structural heart disease characterized by dysfunction of the mitral valve. It can be treated through minimally invasive transcatheter edge-to-edge repair procedures, such as those involving the MitraClip system. Despite its clinical efficacy, the procedure poses technical challenges, requiring interventional cardiologists to undergo multiple procedures to achieve instrumentation proficiency. Previous studies have demonstrated the efficacy of extended reality simulators in improving surgical skill training. The purpose of this study is to evaluate the effectiveness of visuo-haptic feedback within an extended reality simulator to accelerate and enhance the learning process for the MitraClip procedure, potentially offering a valuable tool in surgical training. In this study, based on the prototype of our previous simulator, we further implemented a novel cardiac dynamic environment, a visual feedback interface, an innovative haptic armband, and a new model of the catheter to enhance the simulator’s fidelity and educational usability. Experiment results demonstrated that users benefiting from visuo-haptic feedback exhibited significantly reduced completion times, reduced deviation from predefined trajectories, and presented safer navigation results. Moreover, users preferred the visuo-haptic feedback experience, highlighting its perceived value in enhancing training. These findings underscore the potential of adding visuo-haptic feedback to extended reality simulators in surgical training for complex procedures, improving proficiency and patient surgery outcomes.


  • Human–Robot Shared Control for Osteotomy Procedure

    by Elisa Iovene, Lorenzo Casadio, Junling Fu, Francesco Costa, Giancarlo Ferrigno, Elena De Momi

    Spinal intervention can benefit from advancements in robotic systems, particularly in the field of Human-Robot Interaction (HRI). Despite their potential, robotic technologies remain limited to selected spine procedures. Meanwhile, complex and time-consuming procedures, such as osteotomy, are still performed manually, impacting surgeon workload and stress. This paper introduces a robotic system to assist surgeons during the drilling of the vertebral body, enhancing precision and improving patient outcomes. The system integrates a pre-planning tool for establishing the desired correction angle, a virtual fixture-based impedance control algorithm to assist the user in following cutting trajectories while safeguarding surrounding structures, and a navigation tool for enhanced procedural guidance. The system consists of a 7 Degree-of-Freedom robotic manipulator equipped with a drilling system attached to its end-effector. System accuracy was validated on 5 vertebral phantoms, achieving tracking errors of 0.39 $\pm $ 0.033 mm and 0.74 $\pm $ 0.07 mm, margin errors of 0.84 $\pm $ 0.17 mm and 0.19 $\pm $ 0.5 mm, and angular alignment errors of 0.34 $\pm $ 0.16 and 0.13 $\pm $ 0.27$^{\circ } $ for the sagittal and coronal planes, respectively. Additionally, the system's performance was evaluated with real porcine bone, with results demonstrating similar precision and robustness under realistic mechanical properties. A user Study was conducted to evaluate whether the proposed system effectively enhanced user performance compared to a manual control strategy. The results demonstrated reduced deviation from the desired path and fewer instances of the system exceeding predetermined restricted areas when using the proposed system. Additionally, participants rated the proposed system as less mentally and physically demanding in comparison to the traditional control strategy.


  • Human-Inspired Active Compliant and Passive Shared Control Framework for Robotic Contact-Rich Tasks in Medical Applications

    by Junling Fu, Giorgia Maimone, Elisa Iovene, Jianzhuang Zhao, Alberto Redaelli, Giancarlo Ferrigno, Elena De Momi

    This work presents a compliant and passive shared control framework for teleoperated robot-assisted tasks. Inspired by the human operator's capability of continuously regulating the arm impedance to perform contact-rich tasks, a novel control schema, exploiting the variable impedance control framework for force tracking is proposed. Moreover, bilateral teleoperation and shared control strategies are implemented to alleviate the human operator's workload. Furthermore, a global energy tank-based approach is integrated to enforce the system's passivity. The proposed framework is first evaluated to assess the force-tracking capability when the robot autonomously performs contact-rich tasks, e.g., in an ultrasound scanning scenario. Then, a validation experiment is conducted utilizing the proposed shared control framework. Finally, the system's usability is investigated with 12 users. The experiment results in system assessment revealed a maximum median error of 0.25 N across all the force-tracking experiment setups, i.e., constant and time-varying ones. Then, the validation experiment demonstrated significant improvements regarding the force tracking tasks compared to conventional control methods, and the system passivity was preserved during the task execution. Finally, the usability experiment shows that the human operator workload is significantly reduced by 54.6% compared to the other two control modalities. The proposed framework holds significant potential for the execution of remote robot-assisted medical procedures, such as palpation and ultrasound scanning, particularly in addressing deformation challenges while ensuring safety, compliance, and system passivity.


  • Open Access

    EMG-Based Variable Impedance Control for Enhanced Haptic Feedback in Real-Time Material Recognition

    by Elisa Iovene, Riccardo Monaco, Junling Fu, Francesco Costa, Giancarlo Ferrigno, Elena De Momi

    Advancements in robotic systems hold significant promise for enhancing spinal interventions. Despite this potential, the integration of robotic platforms in spine surgeries remains limited to only a few procedures. This paper presents a variable impedance control scheme within a shared-control framework to enhance haptic feedback during spinal surgeries. The system allows surgeons to guide the robot while dynamically adjusting stiffness based on contact forces and human intent, using electromyography signals. This adaptive control offers real-time guidance during interactions with different materials, serving as a safety measure to safeguard delicate structures encountered during surgical maneuvers. The system comprises a 7-DoF robotic manipulator with a 6-axis force/torque sensor and an 8-channel EMG sensor. Technical validation and a user study assessed performance compared to constant parameter (CIC) and linear variable (LVIC) impedance control methods. Results showed reduced contact force ( $ -5.065 \pm 1.45{\kern2.84526pt}N$ vs CIC's $ -13.72 \pm 6.52 {\kern2.84526pt}N$ and LVIC's $ -8.73 \pm 2.41 {\kern2.84526pt}N$ ) and in-contact displacement ( $ 0.0074 \pm 0.0018 {\kern2.84526pt} m$ vs CIC's $ 0.019 \pm 0.0068 {\kern2.84526pt} m$ and LVIC's $ 0.0125 \pm 0.0028 {\kern2.84526pt} m$ ), when interacting with delicate materials, minimizing the risk to critical anatomical structures. Additionally, a user survey confirmed that the proposed system improved haptic perception and control while preventing undesired movements during interactions with various tissues and structures.


  • Hybrid Tracking Module for Real-Time Tool Tracking for an Autonomous Exoscope

    by Elisa Iovene, Diego Cattaneo, Junling Fu, Giancarlo Ferrigno, Elena De Momi

    Exoscopes have emerged as a promising visual solution within the field of microneurosurgery. However, manual repositioning poses a challenge causing interruptions that disrupt the surgical flow. Thus, the need for hands-free exoscope control arises. This letter introduces a position-based visual-servoing control approach, comprising a detection module, a hybrid tracking module, and a control module that adjusts a robotic camera holder to follow a surgical tool. The hybrid module was integrated to track and predict the surgical tool's future position to minimize system latency. The proposed system is composed of a 7 Degree-of-Freedom robotic manipulator with an eye-in-hand stereo camera. A comparative analysis with three alternative approaches (Convolutional Neural Network - CNN, Particle Filter - PF, Optical Flow - OF) was assessed using Tracking Error and Center Error metrics. Results showed improved tracking accuracy with an average error of $9.84 \pm 0.08$ mm for slow movements (2.5 cm/s) and $13.11 \pm 0.39$ mm for rapid movements (4 cm/s). Finally, a User Study was conducted to investigate whether the proposed system effectively reduced the users' workload compared to the manual repositioning of the camera.


  • Open Access

    Optimization-Based Variable Impedance Control of Robotic Manipulator for Medical Contact Tasks

    by Junling Fu, Ilaria Burzo, Elisa Iovene, Jianzhuang Zhao, Giancarlo Ferrigno, Elena De Momi

    This work presents an optimization-based variable impedance control strategy for controlling a robotic manipulator in medical contact tasks. Specifically, the optimal robot stiffness for performing the medical contact task is obtained using online Quadratic Programming (QP). In the meantime, an energy tank approach is incorporated into the control loop to regulate the system’s passivity. To verify the performance of the proposed strategy, experiments are conducted on both “ static ” and “ scanning ” medical contact tasks, utilizing materials with different properties, different magnitudes of contact forces, as well as uneven conditions with a human torso phantom model and slope surface. The maximum Root Mean Square Error (RMSE) of force tracking with the proposed method in the “ static ” and “ scanning ” tasks , across all setups, is 0.88 N and 0.5 N, respectively. The experiment results demonstrate the superiority of the proposed control strategy compared with traditional manual contact and constant stiffness impedance control-based ones. The proposed control framework is promising to be integrated into robot-assisted medical contact tasks, for example, the palpation and Ultrasound imaging scenarios.


  • Open Access

    Augmented Reality and Human–Robot Collaboration Framework for Percutaneous Nephrolithotomy: System Design, Implementation, and Performance Metrics

    by Junling Fu, Matteo Pecorella, Elisa Iovene, Maria Chiara Palumbo, Alberto Rota, Alberto Redaelli, Giancarlo Ferrigno, Elena De Momi

    During percutaneous nephrolithotomy (PCNL) operations, the surgeon is required to define the incision point on the patient’s back, align the needle to a preplanned path, and perform puncture operations afterward. The procedure is currently performed manually using ultrasound or fluoroscopy imaging for needle orientation, which, however, implies limited accuracy and low reproducibility. This work incorporates augmented reality (AR) visualization with an optical see-through head-mounted display (OST-HMD) and human–robot collaboration (HRC) framework to empower the surgeon’s task completion performance. In detail, eye-to-hand calibration, system registration, and hologram model registration are performed to realize visual guidance. A Cartesian impedance controller is used to guide the operator during the needle-puncture task execution. Experiments are conducted to verify the system performance compared with conventional manual puncture procedures and a 2D monitor-based visualization interface. The results showed that the proposed framework achieves the lowest median and standard deviation error of 3.17 ± 1.36 mm in translation and 1.2 ± .9° in orientation across all of the experimental groups, respectively. Furthermore, the National Aeronautics and Space Administration task load index (NASA-TLX) user evaluation results indicate that the proposed framework requires the lowest workload score of 42.5 ± 13.7 for task completion compared to other experimental setups. The proposed framework exhibits significant potential for clinical application in the PCNL task, as it enhances the surgeon’s perception capability, facilitates collision-free needle insertion path planning, and minimizes errors in task completion.