Towards markerless computer-aided surgery combining deep segmentation and geometric pose estimation: application in total knee arthroplasty
Authors:
- 19 October 2020
- journal article
- research article
- Published by Taylor & Francis in Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization
- Vol. 9 (3) , 271-278
Abstract
Total knee arthroplasty (TKA) is a surgical procedure performed in patients suffering from knee arthritis. The correct positioning of the implants is strongly related to multiple surgical variables that have a tremendous impact on the success of the surgery. Computer-based navigation systems have been investigated and developed in order to assist the surgeon in accurately controlling those surgical variables. The existing technologies are very costly, require additional bone incisions for fixing markers to be tracked, and these markers are usually bulky, interfering with the standard surgical flow. This work presents a markerless navigation system that supports the surgeon in accurately performing the TKA procedure. The proposed system uses a mobile RGB-D camera for replacing the existing optical tracking systems and does not require markers to be tracked. We combine an effective deep learning-based approach for accurately segmenting the bone surface with a robust geometry-based algorithm for registering the bones with pre-operative models. The favourable performance of our pipeline is achieved by (1) employing a semi-supervised labelling approach for generating training data from real TKA surgery data, (2) using effective data augmentation techniques for improving the generalisation capability and (3) using appropriate depth data cleaning strategies. The construction of this complete markerless registration prototype that generalises for unseen intra-operative data is non-obvious, and relevant insights and future research directions can be derived. The experimental results show encouraging performance for video-based TKA.Keywords
Funding Information
- Portuguese Science Foundation and COMPETE2020 program (PTDC/EEIAUT/3024/2014)
This publication has 26 references indexed in Scilit:
- Mediolateral oversizing influences pain, function, and flexion after TKAKnee Surgery, Sports Traumatology, Arthroscopy, 2013
- Robotic-assisted TKA Reduces Postoperative Alignment Outliers and Improves Gap Balance Compared to Conventional TKAClinical Orthopaedics and Related Research, 2013
- Image-guided spine surgery: state of the art and future directionsEuropean Spine Journal, 2009
- EPnP: An Accurate O(n) Solution to the PnP ProblemInternational Journal of Computer Vision, 2008
- 3D registration using a new implementation of the ICP algorithm based on a comprehensive lookup matrix: Application to medical imagingPattern Recognition Letters, 2007
- Surgical navigation for total knee arthroplasty: A perspectiveJournal of Biomechanics, 2007
- Biomechanical background and clinical observations of rotational malalignment in TKA:: Literature review and consequencesClinical Biomechanics, 2005
- Alignment in total knee arthroplastyThe Journal of Bone and Joint Surgery. British volume, 2004
- Complete solution classification for the perspective-three-point problemIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- Current Methods in Medical Image SegmentationAnnual Review of Biomedical Engineering, 2000