Adaptive FOV Control of Laparoscopes With Programmable Composed Constraints
- 28 October 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Robotics and Bionics
- Vol. 1 (4) , 206-217
Abstract
Field of view (FOV) is important for minimally invasive surgeries. However, manual laparoscope manipulation is laborious and requires a lot of training. Assistants’ fatigue and misunderstanding during collaboration will also compromise the quality of FOV. To improve these drawbacks, we developed a new algorithm to automatically manipulate 2-D laparoscopes. The innovative aspect lies in the following ways: the algorithm designs adaptive laws for on-line estimation of depth information, which is difficult to calibrate accurately in advance; To follow moving tools and stabilize FOV around local operations at the same time, a region-based visual servoing method is proposed. We design a novel region factor to deal with regions of different shapes; Aside from the remote center of motion (RCM), the eye-hand coordination problems, especially misorientation, are also key issues for MIS. However, how to reduce the misorientation effects is still an open problem in the literature. We propose a new constraint called the intuitive virtual plane (IVP) constraint to minimize the misorientation; In contrast with the most related works assuming the optical axis and physical axis of a laparoscope are perfectly coincident to each other, our method can be extended to different kinds of laparoscopes without any assumptions on its optical and physical axis with null-space method to decouple image-based visual servoing (IBVS) and RCM-IVP constraints. Experiments are presented to validate the method. Moreover, user studies and interviews are conducted with medical professionals and inexperienced subjects, and the results show that our system is able to improve efficiency, eye-hand coordination, and safety for FOV control of laparoscopes.Keywords
Funding Information
- Hong Kong Research Grants Council (T42-409/18-R, 14202918)
- CUHK T Stone Robotics Institute, CUHK (4930745)
This publication has 25 references indexed in Scilit:
- Kinematic design considerations for minimally invasive surgical robots: an overviewThe International Journal of Medical Robotics and Computer Assisted Surgery, 2012
- A surgical robot with vision field control for single port endoscopic surgeryThe International Journal of Medical Robotics and Computer Assisted Surgery, 2010
- Surgeon workload and motion efficiency with robot and human laparoscopic camera controlSurgical Endoscopy, 2002
- Eye-hand coordination in laparoscopy - an overview of experiments and supporting aidsMinimally Invasive Therapy & Allied Technologies, 2001
- Endoscopic camera rotation: a conceptual solution to improve hand-eye coordination in minimally-invasive surgeryMinimally Invasive Therapy & Allied Technologies, 2000
- Theoretical background and conceptual solution for depth perception and eye-hand coordination problems in laparoscopic surgeryMinimally Invasive Therapy & Allied Technologies, 1999
- Robotically assisted laparoscopic surgerySurgical Endoscopy, 1994
- Kinematic control of redundant robot manipulators: A tutorialJournal of Intelligent & Robotic Systems, 1990
- On the Adaptive Control of Robot ManipulatorsThe International Journal of Robotics Research, 1987
- Visual pattern recognition by moment invariantsIRE Transactions on Information Theory, 1962