AutoCam: Hierarchical Path Planning for an Autonomous Auxiliary Camera in Surgical Robotics
Preprint
Abstract
Incorporating an autonomous auxiliary camera into robot-assisted minimally invasive surgery (RAMIS) enhances spatial awareness and eliminates manual viewpoint control. Existing path planning methods for auxiliary cameras track two-dimensional surgical features but do not simultaneously account for camera orientation, workspace constraints, and robot joint limits. This study presents AutoCam: an automatic auxiliary camera placement method to improve visualization in RAMIS. Implemented on the da Vinci Research Kit, the system uses a priority-based, workspace-constrained control algorithm that combines heuristic geometric placement with nonlinear optimization to ensure robust camera tracking. A user study (N=6) demonstrated that the system maintained 99.84% visibility of a salient feature and achieved a pose error of 4.36 $\pm$ 2.11 degrees and 1.95 $\pm$ 5.66 mm. The controller was computationally efficient, with a loop time of 6.8 $\pm$ 12.8 ms. An additional pilot study (N=6), where novices completed a Fundamentals of Laparoscopic Surgery training task, suggests that users can teleoperate just as effectively from AutoCam's viewpoint as from the endoscope's while still benefiting from AutoCam's improved visual coverage of the scene. These results indicate that an auxiliary camera can be autonomously controlled using the da Vinci patient-side manipulators to track a salient feature, laying the groundwork for new multi-camera visualization methods in RAMIS.
Keywords
All Related Versions
This publication has 36 references indexed in Scilit:
- Automatic calibration of a multi-camera system with limited overlapping fields of view for 3D surgical scene reconstructionInternational Journal of Computer Assisted Radiology and Surgery, 2025
- A multi-camera, multi-view system for training and skill assessment for robot-assisted surgeryInternational Journal of Computer Assisted Radiology and Surgery, 2020
- Development and evaluation of an autonomous camera control algorithm on the da Vinci Surgical SystemThe International Journal of Medical Robotics and Computer Assisted Surgery, 2019
- A “pickup” stereoscopic camera with visual-motor aligned control for the da Vinci surgical system: a preliminary studyInternational Journal of Computer Assisted Radiology and Surgery, 2019
- Preliminary design of an actuated imaging probe for generation of additional visual cues in a robotic surgerySurgical Endoscopy, 2015
- Face, content, and construct validity of four, inanimate training exercises using the da Vinci ® Si surgical system configured with Single-Site ™ instrumentationSurgical Endoscopy, 2014
- Multi-view vision system for laparoscopy surgeryInternational Journal of Computer Assisted Radiology and Surgery, 2014
- Measuring mental workload during the performance of advanced laparoscopic tasksSurgical Endoscopy, 2009
- Toward image-guided robotic surgery: determining intrinsic accuracy of the da Vinci robotInternational Journal of Computer Assisted Radiology and Surgery, 2006
- Dexterity enhancement with robotic surgerySurgical Endoscopy, 2004