Automatic Segmentation of Multiple Structures in Knee Arthroscopy Using Deep Learning
Open Access
- 11 March 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 51853-51861
Abstract
Minimally invasive surgery (MIS) is among the preferred procedures for treating a number of ailments as patients benefit from fast recovery and reduced blood loss. The trade-off is that surgeons lose direct visual contact with the surgical site and have limited intra-operative imaging techniques for real-time feedback. Computer vision methods as well as segmentation and tracking of the tissues and tools in the video frames, are increasingly being adopted to MIS to alleviate such limitations. So far, most of the advances in MIS have been focused on laparoscopic applications, with scarce literature on knee arthroscopy. Here for the first time, we propose a new method for the automatic segmentation of multiple tissue structures for knee arthroscopy. The training data of 3868 images were collected from 4 cadaver experiments, 5 knees, and manually contoured by two clinicians into four classes: Femur, Anterior Cruciate Ligament (ACL), Tibia, and Meniscus. Our approach adapts the U-net and the U-net++ architectures for this segmentation task. Using the cross-validation experiment, the mean Dice similarity coefficients for Femur, Tibia, ACL, and Meniscus are 0.78, 0.50, 0.41, 0.43 using the U-net and 0.79, 0.50, 0.51, 0.48 using the U-net++. While the reported segmentation method is of great applicability in terms of contextual awareness for the surgical team, it can also be used for medical robotic applications such as SLAM and depth mapping.Keywords
Funding Information
- Australia-India Strategic Research Fund (AISRF53820)
- Australian Research Council (DP180103232)
- Queensland University of Technology (project1400000856)
This publication has 49 references indexed in Scilit:
- A Deep Learning Architecture for Image Representation, Visual Interpretability and Automated Basal-Cell Carcinoma Cancer Detection2013
- An effective visualisation and registration system for image-guided robotic partial nephrectomyJournal of Robotic Surgery, 2012
- Advanced stereoscopic projection technology significantly improves novice performance of minimally invasive surgical skillsSurgical Endoscopy, 2012
- Augmented reality in laparoscopic surgical oncologySurgical Oncology, 2011
- Vision-Based Navigation in Image-Guided InterventionsAnnual Review of Biomedical Engineering, 2011
- Real-Time Stereo Reconstruction in Robotically Assisted Minimally Invasive Surgery2010
- Technological Advances in Robotic-Assisted Laparoscopic SurgeryUrologic Clinics of North America, 2009
- Navigation in Endoscopic Soft Tissue Surgery: Perspectives and LimitationsJournal of Endourology, 2008
- Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brainsNeuroImage, 2004
- Learning representations by back-propagating errorsNature, 1986