Florian Richter
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Florian Richter has a total of 50 co-authors. Here are the top co-authors by number of shared publications:
- Michael C. Yip
Department of Electrical and Computer Engineering, University of California, San Diego, La Jolla, CA, USA
9 shared publications Emily K. Funk
Department of Surgery - Division of Head and Neck Surgery, University of California San Diego, La Jolla, CA, USA
4 shared publicationsRyan K. Orosco
Department of Surgery - Division of Head and Neck Surgery, University of California San Diego, La Jolla, CA, USA
4 shared publications- Jingpei Lu
Intuitive Surgical, Inc., Sunnyvale, CA, USA
3 shared publications - Ryan K. Orosco
Department of Surgery, Division of Otolaryngology, University of New Mexico, Albuquerque, NM, USA
3 shared publications - Fei Liu
Department of Electrical Engineering and Computer Science, University of Tennessee Knoxville, Knoxville, TN, USA
2 shared publications
Latest Publications
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (7) , 8608-8615
Stable Tracking-in-the-Loop Control of Cable-Driven RCM Surgical Manipulators Under Erroneous Kinematic Chains
Remote Center of Motion (RCM) robotic manipulators have revolutionized Minimally Invasive Surgery, enabling precise, dexterous surgical manipulation within the patient’s body cavity without disturbing the insertion point on the patient. Accurate RCM tool control is vital for incorporating autonomous subtasks like suturing, blood suction, and tumor resection into robotic surgical procedures, reducing surgeon fatigue and improving patient outcomes. However, these cable-driven systems are subject to significant joint reading errors, corrupting the kinematics computation necessary to perform control. Although visual tracking with endoscopic cameras can correct errors on in-view joints, errors in the kinematic chain prior to the insertion point are irreparable because they remain out of view. No prior work has characterized the stability of control under these conditions. We fill this gap by designing a provably stable tracking-in-the-loop controller for the out-of-view portion of the RCM manipulator kinematic chain. We additionally incorporate this controller into a bilevel control scheme for the full kinematic chain. We rigorously benchmark our method in simulated and real world settings to verify our theoretical findings. Our work provides key insights into the next steps required for the transition from teleoperated to autonomous surgery.
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (7) , 8608-8615
Stable Tracking-in-the-Loop Control of Cable-Driven RCM Surgical Manipulators Under Erroneous Kinematic Chains
Remote Center of Motion (RCM) robotic manipulators have revolutionized Minimally Invasive Surgery, enabling precise, dexterous surgical manipulation within the patient’s body cavity without disturbing the insertion point on the patient. Accurate RCM tool control is vital for incorporating autonomous subtasks like suturing, blood suction, and tumor resection into robotic surgical procedures, reducing surgeon fatigue and improving patient outcomes. However, these cable-driven systems are subject to significant joint reading errors, corrupting the kinematics computation necessary to perform control. Although visual tracking with endoscopic cameras can correct errors on in-view joints, errors in the kinematic chain prior to the insertion point are irreparable because they remain out of view. No prior work has characterized the stability of control under these conditions. We fill this gap by designing a provably stable tracking-in-the-loop controller for the out-of-view portion of the RCM manipulator kinematic chain. We additionally incorporate this controller into a bilevel control scheme for the full kinematic chain. We rigorously benchmark our method in simulated and real world settings to verify our theoretical findings. Our work provides key insights into the next steps required for the transition from teleoperated to autonomous surgery.
- Open Access
- 3 December 2025
- Published by MDPI AG in Bioengineering
- Vol. 12 (12) , 1320
Integration of Artificial Intelligence and Wearable Devices in Pediatric Clinical Care: A Review
Wearable devices are becoming widely applied in healthcare to enable continuous, noninvasive monitoring, but their use in pediatric populations remains relatively underexplored. This review synthesizes 36 clinical studies focused on pediatric hospital and outpatient wearables published between 2014 and 2025. Devices included wrist-worn trackers, adhesive biosensors, and more, capturing electrocardiography, photoplethysmography, accelerometry, and other signals. Clinical applications spanned a variety of care settings. Artificial intelligence (AI) partially enhanced interpretation for the early detection of conditions such as postoperative complications and sepsis. Despite their promising accuracy, most studies remain small, single-center pilots focused on feasibility and signal validity rather than outcomes such as mortality, readmission, or long-term recovery. Key barriers include pediatric-specific device design, motion-robust signal quality, regulatory clearance, workflow integration, and equitable adoption in low-resource settings. Ethical concerns such as privacy, consent, and incidental findings and regulatory constraints, particularly the lack of pediatric labeling and approval for consumer and AI-driven devices, further limit translation into practice. Future work should prioritize multi-center studies, multimodal analytics, explainable AI, and seamless integration into clinical pathways. With these advances, wearables can move beyond feasibility to become reliable, personalized tools that improve pediatric monitoring and care.
- 3 December 2025
- Published by MDPI AG in Bioengineering
- Vol. 12 (12) , 1320
Open AccessIntegration of Artificial Intelligence and Wearable Devices in Pediatric Clinical Care: A Review
Wearable devices are becoming widely applied in healthcare to enable continuous, noninvasive monitoring, but their use in pediatric populations remains relatively underexplored. This review synthesizes 36 clinical studies focused on pediatric hospital and outpatient wearables published between 2014 and 2025. Devices included wrist-worn trackers, adhesive biosensors, and more, capturing electrocardiography, photoplethysmography, accelerometry, and other signals. Clinical applications spanned a variety of care settings. Artificial intelligence (AI) partially enhanced interpretation for the early detection of conditions such as postoperative complications and sepsis. Despite their promising accuracy, most studies remain small, single-center pilots focused on feasibility and signal validity rather than outcomes such as mortality, readmission, or long-term recovery. Key barriers include pediatric-specific device design, motion-robust signal quality, regulatory clearance, workflow integration, and equitable adoption in low-resource settings. Ethical concerns such as privacy, consent, and incidental findings and regulatory constraints, particularly the lack of pediatric labeling and approval for consumer and AI-driven devices, further limit translation into practice. Future work should prioritize multi-center studies, multimodal analytics, explainable AI, and seamless integration into clinical pathways. With these advances, wearables can move beyond feasibility to become reliable, personalized tools that improve pediatric monitoring and care.
- 24 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (4) , 3676-3683
Autonomous Image-to-Grasp Robotic Suturing Using Reliability-Driven Suture Thread Reconstruction
Automating suturing during robotically-assisted surgery reduces the burden on the operating surgeon, enabling them to focus on making higher-level decisions rather than fatiguing themselves in the numerous intricacies of a surgical procedure. Accurate suture thread reconstruction and grasping are vital prerequisites for suturing, particularly for avoiding entanglement with surgical tools and performing complex thread manipulation. However, such methods must be robust to heavy perceptual degradation resulting from heavy noise and thread feature sparsity from endoscopic images. We develop a reconstruction algorithm that utilizes quadratic programming optimization to fit smooth splines to thread observations, satisfying reliability bounds estimated from measured observation noise. Additionally, we craft a grasping policy that generates gripper trajectories that maximize the probability of a successful grasp. Our full image-to-grasp pipeline is rigorously evaluated with over 400 grasping trials, exhibiting state-of-the-art accuracy. We show that this strategy can be applied to the various techniques in autonomous suture needle manipulation to achieve autonomous surgery in a generalizable way.
- 24 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (4) , 3676-3683
Autonomous Image-to-Grasp Robotic Suturing Using Reliability-Driven Suture Thread Reconstruction
Automating suturing during robotically-assisted surgery reduces the burden on the operating surgeon, enabling them to focus on making higher-level decisions rather than fatiguing themselves in the numerous intricacies of a surgical procedure. Accurate suture thread reconstruction and grasping are vital prerequisites for suturing, particularly for avoiding entanglement with surgical tools and performing complex thread manipulation. However, such methods must be robust to heavy perceptual degradation resulting from heavy noise and thread feature sparsity from endoscopic images. We develop a reconstruction algorithm that utilizes quadratic programming optimization to fit smooth splines to thread observations, satisfying reliability bounds estimated from measured observation noise. Additionally, we craft a grasping policy that generates gripper trajectories that maximize the probability of a successful grasp. Our full image-to-grasp pipeline is rigorously evaluated with over 400 grasping trials, exhibiting state-of-the-art accuracy. We show that this strategy can be applied to the various techniques in autonomous suture needle manipulation to achieve autonomous surgery in a generalizable way.
- Open Access
- 4 August 2022
- Published by American Mathematical Society (AMS) in Bulletin of the American Mathematical Society
- Vol. 59 (4) , 569-606
On Katznelson’s Question for skew-product systems
Katznelson’s Question is a long-standing open question concerning recurrence in topological dynamics with strong historical and mathematical ties to open problems in combinatorics and harmonic analysis. In this article, we give a positive answer to Katznelson’s Question for certain towers of skew-product extensions of equicontinuous systems, including systems of the form ( x , t ) ↦ ( x + α , t + h ( x ) ) (x,t) \mapsto (x + \alpha , t + h(x)) . We describe which frequencies must be controlled for in order to ensure recurrence in such systems, and we derive combinatorial corollaries concerning the difference sets of syndetic subsets of the natural numbers.
- 4 August 2022
- Published by American Mathematical Society (AMS) in Bulletin of the American Mathematical Society
- Vol. 59 (4) , 569-606
Open AccessOn Katznelson’s Question for skew-product systems
Katznelson’s Question is a long-standing open question concerning recurrence in topological dynamics with strong historical and mathematical ties to open problems in combinatorics and harmonic analysis. In this article, we give a positive answer to Katznelson’s Question for certain towers of skew-product extensions of equicontinuous systems, including systems of the form ( x , t ) ↦ ( x + α , t + h ( x ) ) (x,t) \mapsto (x + \alpha , t + h(x)) . We describe which frequencies must be controlled for in order to ensure recurrence in such systems, and we derive combinatorial corollaries concerning the difference sets of syndetic subsets of the natural numbers.
- 16 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (2) , 4622-4629
Pose Estimation for Robot Manipulators via Keypoint Optimization and Sim-to-Real Transfer
Keypoint detection is an essential building block for many robotic applications like motion capture and pose estimation. Historically, keypoints are detected using uniquely engineered markers such as checkerboards or fiducials. More recently, deep learning methods have been explored as they have the ability to detect user-defined keypoints in a marker-less manner. However, different manually selected keypoints can have uneven performance when it comes to detection and localization. An example of this can be found on symmetric robotic tools where DNN detectors cannot solve the correspondence problem correctly. In this work, we propose a new and autonomous way to define the keypoint locations that overcomes these challenges. The approach involves finding the optimal set of keypoints on robotic manipulators for robust visual detection and localization. Using a robotic simulator as a medium, our algorithm utilizes synthetic data for DNN training, and the proposed algorithm is used to optimize the selection of keypoints through an iterative approach. The results show that when using the optimized keypoints, the detection performance of the DNNs improved significantly. We further use the optimized keypoints for real robotic applications by using domain randomization to bridge the reality gap between the simulator and the physical world. The physical world experiments show how the proposed method can be applied to the wide-breadth of robotic applications that require visual feedback, such as camera-to-robot calibration, robotic tool tracking, and end-effector pose estimation. As a way to encourage further research in this topic, we establish the “Robot Pose” dataset, comprising calibration and tracking problems and ground truth data, available online 1.
- 16 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (2) , 4622-4629
Pose Estimation for Robot Manipulators via Keypoint Optimization and Sim-to-Real Transfer
Keypoint detection is an essential building block for many robotic applications like motion capture and pose estimation. Historically, keypoints are detected using uniquely engineered markers such as checkerboards or fiducials. More recently, deep learning methods have been explored as they have the ability to detect user-defined keypoints in a marker-less manner. However, different manually selected keypoints can have uneven performance when it comes to detection and localization. An example of this can be found on symmetric robotic tools where DNN detectors cannot solve the correspondence problem correctly. In this work, we propose a new and autonomous way to define the keypoint locations that overcomes these challenges. The approach involves finding the optimal set of keypoints on robotic manipulators for robust visual detection and localization. Using a robotic simulator as a medium, our algorithm utilizes synthetic data for DNN training, and the proposed algorithm is used to optimize the selection of keypoints through an iterative approach. The results show that when using the optimized keypoints, the detection performance of the DNNs improved significantly. We further use the optimized keypoints for real robotic applications by using domain randomization to bridge the reality gap between the simulator and the physical world. The physical world experiments show how the proposed method can be applied to the wide-breadth of robotic applications that require visual feedback, such as camera-to-robot calibration, robotic tool tracking, and end-effector pose estimation. As a way to encourage further research in this topic, we establish the “Robot Pose” dataset, comprising calibration and tracking problems and ground truth data, available online 1.
- 1 December 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 925-934
SCORER-Gap: Sequentially Correlated Rules for Event Recommendation Considering Gap Size
Finding significant events, which follow a specific pattern, is an essential task in sequential rule mining. While the significance of a rule often is based on conditions like a maximum amount of time [1], or a minimum distance between patterns [2], the area between these two extremes is rarely analyzed. This paper aims at the discovery of partially-ordered sequential rules which satisfy a given correlation gap constraint. Applying this constraint to the support threshold determines a more relevant rule, among other parameters. We also require it in sparse datasets, where long sequences with many distinct events exist. This setting can be found in online product configurators, where the basis is an unstructured process that combines both high-level and fine-grained configuration steps. In general, our novel approach SCORER-Gap can be applied to procedures with a high variability of events.By focusing on the gap size between antecedent and consequent of a rule, we show that usually, the resulting vast number of rules gets highly reduced while keeping the flexibility between a minimum and a maximum distance in between. To implement our novel approach, we use an in-mining setup, namely RuleGrowth [1] to which we attach the correlation gap constraint as mentioned above. The code is available on [3]. For an extensive analysis of application areas, we use three real-world datasets consisting of different characteristics. We start with a Covid19 genome sequence representing a highly dense dataset. Additionally, an industrial database and the clickstream of a Hungarian news website (Kosarak) are used as representatives for increasingly sparse datasets.SCORER-Gap shows a high percentual reduction in the number of rules in the resulting ruleset while slightly increasing accuracy in a train and test setting. Furthermore, a high proportion of recommendation rules differs between RuleGrowth and SCORER-Gap.
- 1 December 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 925-934
SCORER-Gap: Sequentially Correlated Rules for Event Recommendation Considering Gap Size
Finding significant events, which follow a specific pattern, is an essential task in sequential rule mining. While the significance of a rule often is based on conditions like a maximum amount of time [1], or a minimum distance between patterns [2], the area between these two extremes is rarely analyzed. This paper aims at the discovery of partially-ordered sequential rules which satisfy a given correlation gap constraint. Applying this constraint to the support threshold determines a more relevant rule, among other parameters. We also require it in sparse datasets, where long sequences with many distinct events exist. This setting can be found in online product configurators, where the basis is an unstructured process that combines both high-level and fine-grained configuration steps. In general, our novel approach SCORER-Gap can be applied to procedures with a high variability of events.By focusing on the gap size between antecedent and consequent of a rule, we show that usually, the resulting vast number of rules gets highly reduced while keeping the flexibility between a minimum and a maximum distance in between. To implement our novel approach, we use an in-mining setup, namely RuleGrowth [1] to which we attach the correlation gap constraint as mentioned above. The code is available on [3]. For an extensive analysis of application areas, we use three real-world datasets consisting of different characteristics. We start with a Covid19 genome sequence representing a highly dense dataset. Additionally, an industrial database and the clickstream of a Hungarian news website (Kosarak) are used as representatives for increasingly sparse datasets.SCORER-Gap shows a high percentual reduction in the number of rules in the resulting ruleset while slightly increasing accuracy in a train and test setting. Furthermore, a high proportion of recommendation rules differs between RuleGrowth and SCORER-Gap.
- 8 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 38 (3) , 1653-1670
Robotic Tool Tracking Under Partially Visible Kinematic Chain: A Unified Approach
Anytime a robot manipulator is controlled via visual feedback, the transformation between the robot and camera frame must be known. However, in the case where cameras can only capture a portion of the robot manipulator in order to better perceive the environment being interacted with, there is greater sensitivity to errors in calibration of the base-to-camera transform. A secondary source of uncertainty during robotic control are inaccuracies in joint angle measurements which can be caused by biases in positioning and complex transmission effects such as backlash and cable stretch. In this work, we bring together these two sets of unknown parameters into a unified problem formulation when the kinematic chain is partially visible in the camera view. We prove that these parameters are nonidentifiable implying that explicit estimation of them is infeasible. To overcome this, we derive a smaller set of parameters we call lumped error since it lumps together the errors of calibration and joint angle measurements. A particle filter method is presented and tested in simulation and on two real world robots to estimate the lumped error and show the efficiency of this parameter reduction.
- 8 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 38 (3) , 1653-1670
Robotic Tool Tracking Under Partially Visible Kinematic Chain: A Unified Approach
Anytime a robot manipulator is controlled via visual feedback, the transformation between the robot and camera frame must be known. However, in the case where cameras can only capture a portion of the robot manipulator in order to better perceive the environment being interacted with, there is greater sensitivity to errors in calibration of the base-to-camera transform. A secondary source of uncertainty during robotic control are inaccuracies in joint angle measurements which can be caused by biases in positioning and complex transmission effects such as backlash and cable stretch. In this work, we bring together these two sets of unknown parameters into a unified problem formulation when the kinematic chain is partially visible in the camera view. We prove that these parameters are nonidentifiable implying that explicit estimation of them is infeasible. To overcome this, we derive a smaller set of parameters we call lumped error since it lumps together the errors of calibration and joint angle measurements. A particle filter method is presented and tested in simulation and on two real world robots to estimate the lumped error and show the efficiency of this parameter reduction.
- 6 September 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 38 (2) , 797-809
ARCSnake: Reconfigurable Snakelike Robot With Archimedean Screw Propulsion for Multidomain Mobility
Exploring and navigating in extreme environments, such as caves, oceans, and planetary bodies, are often too hazardous for humans, and as such, robots are possible surrogates. These robots are met with significant locomotion challenges that require traversing a wide range of surface roughnesses and topologies. Previous locomotion strategies, involving wheels or ambulatory motion, such as snake platforms, have success on specific surfaces but fail in others, which could be detrimental in exploration and navigation missions. In this article, we present a novel approach that combines snakelike robots with an Archimedean screw locomotion mechanism to provide multiple, effective mobility strategies in a large range of environments, including those that are difficult to traverse for wheeled and ambulatory robots. This work develops a robotic system called ARCSnake to demonstrate this locomotion principle and tested it in a variety of different terrains and environments in order to prove its controllable, multidomain, navigation capabilities. These tests show a wide breadth of scenarios that ARCSnake can handle, hence demonstrating its ability to traverse through extreme terrains.
- 6 September 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 38 (2) , 797-809
ARCSnake: Reconfigurable Snakelike Robot With Archimedean Screw Propulsion for Multidomain Mobility
Exploring and navigating in extreme environments, such as caves, oceans, and planetary bodies, are often too hazardous for humans, and as such, robots are possible surrogates. These robots are met with significant locomotion challenges that require traversing a wide range of surface roughnesses and topologies. Previous locomotion strategies, involving wheels or ambulatory motion, such as snake platforms, have success on specific surfaces but fail in others, which could be detrimental in exploration and navigation missions. In this article, we present a novel approach that combines snakelike robots with an Archimedean screw locomotion mechanism to provide multiple, effective mobility strategies in a large range of environments, including those that are difficult to traverse for wheeled and ambulatory robots. This work develops a robotic system called ARCSnake to demonstrate this locomotion principle and tested it in a variety of different terrains and environments in order to prove its controllable, multidomain, navigation capabilities. These tests show a wide breadth of scenarios that ARCSnake can handle, hence demonstrating its ability to traverse through extreme terrains.
- Top Cited Papers
- 1 February 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (2) , 1383-1390
Autonomous Robotic Suction to Clear the Surgical Field for Hemostasis Using Image-Based Blood Flow Detection
Autonomous robotic surgery has seen significant progression over the last decade with the aims of reducing surgeon fatigue, improving procedural consistency, and perhaps one day take over surgery itself. However, automation has not been applied to the critical surgical task of controlling tissue and blood vessel bleeding-known as hemostasis. The task of hemostasis covers a spectrum of bleeding sources and a range of blood velocity, trajectory, and volume. In an extreme case, an un-controlled blood vessel fills the surgical field with flowing blood. In this work, we present the first, automated solution for hemostasis through development of a novel probabilistic blood flow detection algorithm and a trajectory generation technique that guides autonomous suction tools towards pooling blood. The blood flow detection algorithm is tested in both simulated scenes and in a real-life trauma scenario involving a hemorrhage that occurred during thyroidectomy. The complete solution is tested in a physical lab setting with the da Vinci Research Kit (dVRK) and a simulated surgical cavity for blood to flow through. The results show that our automated solution has accurate detection, a fast reaction time, and effective removal of the flowing blood. Therefore, the proposed methods are powerful tools to clearing the surgical field which can be followed by either a surgeon or future robotic automation developments to close the vessel rupture.
- 1 February 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (2) , 1383-1390
Top Cited PapersAutonomous Robotic Suction to Clear the Surgical Field for Hemostasis Using Image-Based Blood Flow Detection
Autonomous robotic surgery has seen significant progression over the last decade with the aims of reducing surgeon fatigue, improving procedural consistency, and perhaps one day take over surgery itself. However, automation has not been applied to the critical surgical task of controlling tissue and blood vessel bleeding-known as hemostasis. The task of hemostasis covers a spectrum of bleeding sources and a range of blood velocity, trajectory, and volume. In an extreme case, an un-controlled blood vessel fills the surgical field with flowing blood. In this work, we present the first, automated solution for hemostasis through development of a novel probabilistic blood flow detection algorithm and a trajectory generation technique that guides autonomous suction tools towards pooling blood. The blood flow detection algorithm is tested in both simulated scenes and in a real-life trauma scenario involving a hemorrhage that occurred during thyroidectomy. The complete solution is tested in a physical lab setting with the da Vinci Research Kit (dVRK) and a simulated surgical cavity for blood to flow through. The results show that our automated solution has accurate detection, a fast reaction time, and effective removal of the flowing blood. Therefore, the proposed methods are powerful tools to clearing the surgical field which can be followed by either a surgeon or future robotic automation developments to close the vessel rupture.
- Open Access
Autonomous Robotic Suction to Clear the Surgical Field for Hemostasis using Image-based Blood Flow Detection
Autonomous robotic surgery has seen significant progression over the last decade with the aims of reducing surgeon fatigue, improving procedural consistency, and perhaps one day take over surgery itself. However, automation has not been applied to the critical surgical task of controlling tissue and blood vessel bleeding--known as hemostasis. The task of hemostasis covers a spectrum of bleeding sources and a range of blood velocity, trajectory, and volume. In an extreme case, an un-controlled blood vessel fills the surgical field with flowing blood. In this work, we present the first, automated solution for hemostasis through development of a novel probabilistic blood flow detection algorithm and a trajectory generation technique that guides autonomous suction tools towards pooling blood. The blood flow detection algorithm is tested in both simulated scenes and in a real-life trauma scenario involving a hemorrhage that occurred during thyroidectomy. The complete solution is tested in a physical lab setting with the da Vinci Research Kit (dVRK) and a simulated surgical cavity for blood to flow through. The results show that our automated solution has accurate detection, a fast reaction time, and effective removal of the flowing blood. Therefore, the proposed methods are powerful tools to clearing the surgical field which can be followed by either a surgeon or future robotic automation developments to close the vessel rupture.
Open AccessAutonomous Robotic Suction to Clear the Surgical Field for Hemostasis using Image-based Blood Flow Detection
Autonomous robotic surgery has seen significant progression over the last decade with the aims of reducing surgeon fatigue, improving procedural consistency, and perhaps one day take over surgery itself. However, automation has not been applied to the critical surgical task of controlling tissue and blood vessel bleeding--known as hemostasis. The task of hemostasis covers a spectrum of bleeding sources and a range of blood velocity, trajectory, and volume. In an extreme case, an un-controlled blood vessel fills the surgical field with flowing blood. In this work, we present the first, automated solution for hemostasis through development of a novel probabilistic blood flow detection algorithm and a trajectory generation technique that guides autonomous suction tools towards pooling blood. The blood flow detection algorithm is tested in both simulated scenes and in a real-life trauma scenario involving a hemorrhage that occurred during thyroidectomy. The complete solution is tested in a physical lab setting with the da Vinci Research Kit (dVRK) and a simulated surgical cavity for blood to flow through. The results show that our automated solution has accurate detection, a fast reaction time, and effective removal of the flowing blood. Therefore, the proposed methods are powerful tools to clearing the surgical field which can be followed by either a surgeon or future robotic automation developments to close the vessel rupture.