Enabling Robotic Tele-Microsurgery: High-Resolution RGB-D Streaming Based on Swept Source OCT and Data-Driven Galvanometer Control
- 16 July 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 30 (6) , 7843-7854
Abstract
This article presents a real-time RGB-D imaging system for robot-assisted remote microsurgery, integrating advanced optics, mechatronics, and dynamic control theory. The system combines a swept-source optical coherence tomography (SS-OCT) probe with a micro RGB camera, exploiting the SS-OCT’s high depth resolution and fast scan rate to generate accurate depth maps co-registered with the camera’s color data. A dual-axis galvanometer scanner, controlled by a fractional-order repetitive control algorithm with a data-driven inverse filter, enables real-time imaging at 30 fps with dynamically adjustable scan areas. Experimental evaluations highlight the system’s exceptional depth-sensing capabilities, including sub-millimeter resolution, precise depth mapping, and smooth dynamic scanning. In addition, the system enhances visual guidance during robotic microsurgery, as validated in teleoperated vessel ligation on a phantom and a cadaveric porcine model.Keywords
Funding Information
- National Science and Technology Council in Taiwan (NSTC 112-2628-E-002-021-MY3)
This publication has 28 references indexed in Scilit:
- Implementation Strategies and Ergonomic Factors in Robot-assisted MicrosurgeryJournal of Robotic Surgery, 2025
- Modeling-free Learning Control of Cross-coupled Fast Steering Mirror for 2-D TrajectoryIFAC-PapersOnLine, 2023
- An all-pass based internal model principle controller for galvanometer mirror steeringControl Engineering Practice, 2023
- FRSR: Framework for real-time scene reconstruction in robot-assisted minimally invasive surgeryComputers in Biology and Medicine, 2023
- Application of robot-assisted endoscopic technique in the treatment of patent ductus arteriosus in 106 childrenJournal of Robotic Surgery, 2023
- Model-free repetitive control design and implementation for dynamical galvanometer-based raster scanningControl Engineering Practice, 2022
- ASTEMA: Design and preliminary performance assessment of a novel tele-microsurgery systemMechatronics, 2022
- Early Experience Using a New Robotic Microsurgical System for Lymphatic SurgeryPlastic and Reconstructive Surgery - Global Open, 2022
- A simple system of swept source optical coherence tomography for a large imaging depth rangeOptics Communications, 2019
- Live volumetric (4D) visualization and guidance of in vivo human ophthalmic surgery with intraoperative optical coherence tomographyScientific Reports, 2016