Autonomous Magnetic Navigation in Endoscopic Image Mosaics
Open Access
- 14 March 2024
- journal article
- research article
- Published by Wiley in Advanced Science
- Vol. 11 (19) , e2400980
Abstract
Endoscopes navigate within the human body to observe anatomical structures with minimal invasiveness. A major shortcoming of their use is their narrow field‐of‐view during navigation in large, hollow anatomical regions. Mosaics of endoscopic images can provide surgeons with a map of the tool's environment. This would facilitate procedures, improve their efficiency, and potentially generate better patient outcomes. The emergence of magnetically steered endoscopes opens the way to safer procedures and creates an opportunity to provide robotic assistance both in the generation of the mosaic map and in navigation within this map. This paper proposes methods to autonomously navigate magnetic endoscopes to 1) generate endoscopic image mosaics and 2) use these mosaics as user interfaces to navigate throughout the explored area. These are the first strategies, which allow autonomous magnetic navigation in large, hollow organs during minimally invasive surgeries. The feasibility of these methods is demonstrated experimentally both in vitro and ex vivo in the context of the treatment of twin‐to‐twin transfusion syndrome. This minimally invasive procedure is performed in utero and necessitates coagulating shared vessels of twin fetuses on the placenta. A mosaic of the vasculature in combination with autonomous navigation has the potential to significantly facilitate this challenging surgery.Keywords
Funding Information
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (200020_212885)
- European Research Council (743217)
- Innovation and Technology Commission (InnoHK)
This publication has 36 references indexed in Scilit:
- Magnetosurgery: Principles, design, and applicationsSmart Materials in Medicine, 2024
- Placental vessel segmentation and registration in fetoscopy: Literature review and MICCAI FetReg2021 challenge findingsMedical Image Analysis, 2023
- Robust endoscopic image mosaicking via fusion of multimodal estimationMedical Image Analysis, 2022
- Magnetically Guided Laser Surgery for the Treatment of Twin‐to‐Twin Transfusion SyndromeAdvanced Intelligent Systems, 2022
- Robust fetoscopic mosaicking from deep learned flow fieldsInternational Journal of Computer Assisted Radiology and Surgery, 2022
- A systematic review of robotic surgery: From supervised paradigms to fully autonomous robotic approachesThe International Journal of Medical Robotics and Computer Assisted Surgery, 2021
- Deep Placental Vessel Segmentation for Fetoscopic Mosaicking2020
- Optical flow-based structure-from-motion for the reconstruction of epithelial surfacesPattern Recognition, 2020
- Update on twin-to-twin transfusion syndromeBest Practice & Research Clinical Obstetrics & Gynaecology, 2019
- Magnetic guidance system for cardiac electrophysiologyJACC, 2003