Automatic detection and segmentation of chorda tympani under microscopic vision in otosclerosis patients via convolutional neural networks
Authors:
- 26 August 2023
- journal article
- research article
- Published by Wiley in The International Journal of Medical Robotics and Computer Assisted Surgery
- Vol. 19 (6) , e2567
Abstract
Background: Artificial intelligence (AI) techniques, especially deep learning (DL) techniques, have shown promising results for various computer vision tasks in the field of surgery. However, AI‐guided navigation during microscopic surgery for real‐time surgical guidance and decision support is much more complex, and its efficacy has yet to be demonstrated. We propose a model dedicated to the evaluation of DL‐based semantic segmentation of chorda tympani (CT) during microscopic surgery.Methods: Various convolutional neural networks were constructed, trained, and validated for semantic segmentation of CT. Our dataset has 5817 images annotated from 36 patients, which were further randomly split into the training set (90%, 5236 images) and validation set (10%, 581 images). In addition, 1500 raw images from 3 patients (500 images randomly selected per patient) were used to evaluate the network performance.Results: When evaluated on a validation set (581 images), our proposed CT detection networks achieved great performance, and the modified U‐net performed best (mIOU = 0.892, mPA = 0.9427). Moreover, when applying U‐net to predict the test set (1500 raw images from 3 patients), our methods also showed great overall performance (Accuracy = 0.976, Precision = 0.996, Sensitivity = 0.979, Specificity = 0.902).Conclusions: This study suggests that DL can be used for the automated detection and segmentation of CT in patients with otosclerosis during microscopic surgery with a high degree of performance. Our research validated the potential feasibility for future vision‐based navigation surgical assistance and autonomous surgery using AI.Keywords
Funding Information
- National Key Research and Development Program of China (2019YFB1311801)
This publication has 25 references indexed in Scilit:
- Taste Changes in Patients With Middle Ear Surgery by Intraoperative Manipulation of Chorda Tympani NerveOtology & Neurotology, 2018
- Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks2018
- Feasibility of preservation of chorda tympani nerve during noninflammatory ear surgery: A systematic reviewThe Laryngoscope, 2017
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017
- Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus PhotographsJAMA, 2016
- Integrating Online and Offline Three-Dimensional Deep Learning for Automated Polyp Detection in Colonoscopy VideosIEEE Journal of Biomedical and Health Informatics, 2016
- Machine Learning in MedicineCirculation, 2015
- Taste function after stapes surgeryAuris Nasus Larynx, 2012
- Iatrogenic injury of the chorda tympani: a systematic reviewThe Journal of Laryngology & Otology, 2011
- Taste disturbance after stapes surgery – clinical and experimental studyActa Oto-Laryngologica, 2009