An AI-Based Sensorless Force Feedback in Robot-Assisted Minimally Invasive Surgery

Authors:
Open Access
Publisher website
Google Scholar
Abstract
(1) Background: Most robotic MIS platforms lack native haptic feedback, leaving surgeons to infer tissue loads from vision alone—an especially risky limitation in esophageal procedures. (2) Methods: We develop a sensorless, image-only force-estimation pipeline that maps endoscopic video to tool–tissue forces using a lightweight EfficientNetV2B0 CNN. The model is trained on 9691 labeled frames from in vitro esophageal experiments and validated against an FT300 load cell. For intraoperative feasibility, the system is deployed as a plug-in on PARA-SILSROB, consuming the existing laparoscope feed and driving a commercial haptic device. The runtime processes every 10th frame of a 60 FPS stream (≈6 Hz updates) with ~15–20 ms per-prediction latency. (3) Results: On held-out tests, the model achieves MAE = 0.017 N and MSE = 0.0004 N2, outperforming a recurrent CNN baseline while maintaining real-time performance on commodity hardware. Integrated evaluations confirm stable operation at the deployed update rate and low latency compatible with closed-loop haptics. (4) Conclusions: By avoiding distal force sensors and preserving sterile workflow, the approach is readily translatable and retrofit-friendly for current robotic platforms. The results support the practical feasibility of real-time, sensorless force feedback for robotic esophagectomy and related MIS tasks, with potential to reduce tissue trauma and enhance operative safety.
Funding Information
  • project “Romanian Hub for Artificial Intelligence -HRIA”, Smart Growth, Digitization and Financial Instruments Program (334906)

This publication has 37 references indexed in Scilit: