EfficientEndoSeg: A Lightweight YOLOv5-Based Framework for Endoscopic Surgical Instrument Segmentation and Skill-Related Motion Analysis
Open Access
- 13 May 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 74030-74047
Abstract
This study addresses the challenge of achieving accurate and real-time surgical instrument instance segmentation under strict computational constraints in minimally invasive surgery by proposing EfficientEndoSeg, a compact and high-throughput segmentation framework coupled with tool-tip analysis. Building on the You Only Look Once (YOLO) version 5 instance segmentation baseline, EfficientEndoSeg incorporates four targeted architectural refinements: the C3SG2 module combining GhostNetV2 and Swin Transformer components to enhance local–global representation, Ghost Convolution for parameter-efficient feature extraction, a Double-Attention (A2) block for contextual refinement, and Complete Intersection-over-Union–guided Soft Non-Maximum Suppression to improve robustness in crowded surgical scenes. The framework is systematically evaluated on an internally annotated extension of the m2cai16-tool dataset, comprising 5,249 endoscopic frames and 8,785 polygon-level annotations across seven instrument categories, which serves as a controlled benchmark for experimental validation. These architectural modifications reduce model parameters by 25% and increase inference throughput by 52.7%, while consistently improving recall and mean Average Precision across multiple Intersection-over-Union thresholds. The proposed model matches or surpasses recent YOLO version 7 to version 12 variants and remains competitive with transformer-based and two-stage frameworks, including SegFormer, ISINet, LETNet, Detectron2, and Mask R-CNN. In addition, a training-free tool-tip tracking module based on modified K3M skeletonization enables trajectory, heatmap, and usage analyses, facilitating qualitative skill-related motion assessment without additional learning overhead. Overall, EfficientEndoSeg delivers a reproducible, lightweight, and deployment-ready solution for segmentation-driven surgical scene understanding and instrument motion analysis.Keywords
This publication has 34 references indexed in Scilit:
- LiMS-Net: Lightweight metal surface defect detection networkDisplays, 2025
- MHAED-Net: a lightweight multiscale hybrid attention encoder-decoder network for the efficient segmentation of industrial forging imagesThe Journal of Supercomputing, 2025
- Deep learning for surgical instrument recognition and segmentation in robotic-assisted surgeries: a systematic reviewArtificial Intelligence Review, 2024
- YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information2024
- ByteTrack: Multi-object Tracking by Associating Every Detection Box2022
- Mask then classify: multi-instance segmentation for surgical instrumentsInternational Journal of Computer Assisted Radiology and Surgery, 2021
- ISINet: An Instance-Based Approach for Surgical Instrument Segmentation2020
- Designing a New Endoscope for Panoramic-View with Focus-Area 3D-Vision in Minimally Invasive SurgeryJournal of Medical and Biological Engineering, 2019
- Vision-based and marker-less surgical tool detection and tracking: a review of the literatureMedical Image Analysis, 2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015