Unsupervised Anomaly Detection for a Smart Autonomous Robotic Assistant Surgeon (SARAS) Using a Deep Residual Autoencoder
Open Access
- 14 July 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (4) , 7256-7261
Abstract
Anomaly detection in Minimally-Invasive Surgery (MIS) traditionally requires a human expert monitoring the procedure from a console, whereas automated anomaly detection systems in this area typically rely on classical supervised learning. Anomalous surgical events, however, are rare, making it difficult to capture data to train a model in a supervised fashion. In this work we propose an unsupervised approach to anomaly detection for robotic MIS based on deep residual autoencoders. The idea is to make the autoencoder learn the ‘normal’ distribution of the data and detect abnormal events deviating from this distribution by measuring a reconstruction error. The model is trained and validated upon both the publicly available Cholec80 dataset and a set of videos captured on procedures using artificial anatomies (‘phantoms’) as part of the Smart Autonomous Robotic Assistant Surgeon (SARAS) project. The system achieves recall and precision equal to 78.4%, 91.5%, respectively, on Cholec80 and of 95.6%, 88.1% on the SARAS phantom dataset. The system was developed and deployed as part of the SARAS platform for real-time anomaly detection with a processing time of 25 ms per frame.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic VideosIEEE Transactions on Medical Imaging, 2016
- A direct GABAergic output from the basal ganglia to frontal cortexNature, 2015
- Automated Bleeding Detection in Capsule Endoscopy Videos Using Statistical Features and Region GrowingJournal of Medical Systems, 2014
- Computer-Aided Bleeding Detection in WCE VideoIEEE Journal of Biomedical and Health Informatics, 2014
- Prefrontal microcircuit underlies contextual learning after hippocampal lossProceedings of the National Academy of Sciences, 2013
- Aggregating Local Image Descriptors into Compact CodesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- From medical images to minimally invasive intervention: Computer assistance for robotic surgeryComputerized Medical Imaging and Graphics, 2010
- Computer-Aided Detection of Bleeding Regions for Capsule Endoscopy ImagesIEEE Transactions on Biomedical Engineering, 2009
- Obscure bleeding detection in endoscopy images using support vector machinesOptimization and Engineering, 2008
- Locally adapted hierarchical basis preconditioning2006