Intelligent surgical workflow recognition-based skill assessment for minimally invasive submandibular gland resection
Open Access
- 7 July 2026
- journal article
- research article
- Published by Springer Nature in npj Digital Medicine
- Vol. 9 (1)
Abstract
Artificial Intelligence (AI) is transforming clinical dental practice, with most applications focusing on static images like radiographs. However, the integration of AI in analyzing video data, particularly in surgical settings rich in dynamic information, remains underexplored in oral medicine. This study introduces AI-miSMG, an intelligent surgical workflow recognition model designed for minimally invasive submandibular gland (SMG) resection. Building upon our previous work, we established a standardized annotation protocol to efficiently label endoscopic SMG resection procedures, which are divided into Creation, Position, Separation, Inspection, and Idle phases. The AI-miSMG model was trained on a dataset of 73 high-quality endoscopic SMG resection videos, comprising 386,122 labeled frames. To evaluate its performance, we used a multicenter dataset consisting of surgical videos from four different centers, totaling 85,913 images. The model achieved an overall accuracy of 0.87 on the external validation dataset. Additionally, it was explored for workflow-based analysis of surgical fluency across surgeons with different experience levels. Furthermore, our model reduced annotation time by approximately 47%, decreasing from 94.00 min to 49.90 min. Overall, we developed a deep learning-based workflow recognition model for minimally invasive SMG resection and demonstrated its feasibility for surgical phase recognition, workflow analysis, and model-assisted annotation.Keywords
Funding Information
- Natural Science Foundation of Sichuan Province (2025ZNSFSC0645)
- Postdoctoral Fellowship Program of CPSF (GZC20231787)
- Health Commission of Sichuan Province Medical Science and Technology Program (24CXTD07)
- West China Hospital of Stomatology (RD-03-202309)
This publication has 52 references indexed in Scilit:
- Early detection of Alzheimer's disease using deep learning methodsAlzheimer's & Dementia, 2025
- Clinical and patient-reported outcomes between full-endoscopic and conventional parotidectomy: a prospective cohort studyClinical Oral Investigations, 2025
- Full Endoscopic Procedures of Total ParotidectomyThe Laryngoscope, 2024
- Endoscopic Neck Dissection and Intraoral Approach for Oral Cancer and Free Flap ReconstructionThe Laryngoscope, 2024
- Surgical step recognition in laparoscopic distal gastrectomy using artificial intelligence: a proof-of-concept studyLangenbeck's Archives of Surgery, 2024
- Analyzing Surgical Technique in Diverse Open Surgical Videos With Multitask Machine LearningJAMA Surgery, 2024
- Automatic surgical phase recognition-based skill assessment in laparoscopic distal gastrectomy using multicenter videosGastric Cancer, 2023
- Automatic Surgical Skill Assessment System Based on Concordance of Standardized Surgical Field Development Using Artificial IntelligenceJAMA Surgery, 2023
- Automatic surgical phase recognition in laparoscopic inguinal hernia repair with artificial intelligenceHernia, 2022
- Association Between Surgeon Technical Skills and Patient OutcomesJAMA Surgery, 2020