Reducing image variability across OCT devices with unsupervised unpaired learning for improved segmentation of retina
- 20 December 2019
- journal article
- research article
- Published by Optica Publishing Group in Biomedical Optics Express
- Vol. 11 (1) , 346-363
Abstract
Diagnosis and treatment in ophthalmology depend on modern retinal imaging by optical coherence tomography (OCT). The recent staggering results of machine learning in medical imaging have inspired the development of automated segmentation methods to identify and quantify pathological features in OCT scans. These models need to be sensitive to image features defining patterns of interest, while remaining robust to differences in imaging protocols. A dominant factor for such image differences is the type of OCT acquisition device. In this paper, we analyze the ability of recently developed unsupervised unpaired image translations based on cycle consistency losses (cycleGANs) to deal with image variability across different OCT devices (Spectralis and Cirrus). This evaluation was performed on two clinically relevant segmentation tasks in retinal OCT imaging: fluid and photoreceptor layer segmentation. Additionally, a visual Turing test designed to assess the quality of the learned translation models was carried out by a group of 18 participants with different background expertise. Results show that the learned translation models improve the generalization ability of segmentation models to other OCT-vendors/domains not seen during training. Moreover, relationships between model hyper-parameters and the realism as well as the morphological consistency of the generated images could be identified.Keywords
Funding Information
- Christian Doppler Forschungsgesellschaft
- Bundesministerium für Digitalisierung und Wirtschaftsstandort
- Rat für Forschung und Technologieentwicklung
This publication has 12 references indexed in Scilit:
- On the Effectiveness of Least Squares Generative Adversarial NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- Clinically applicable deep learning for diagnosis and referral in retinal diseaseNature Medicine, 2018
- Fully Automated Detection and Quantification of Macular Fluid in OCT Using Deep LearningOphthalmology, 2018
- A survey on deep learning in medical image analysisMedical Image Analysis, 2017
- Automated Retinal Layer Segmentation Using Spectral Domain Optical Coherence Tomography: Evaluation of Inter-Session Repeatability and Agreement between DevicesPLOS ONE, 2016
- The Development, Commercialization, and Impact of Optical Coherence TomographyInvestigative Ophthalmology & Visual Science, 2016
- Fast Patch-Based Pseudo-CT Synthesis from T1-Weighted MR Images for PET/MR Attenuation Correction in Brain StudiesJournal of Nuclear Medicine, 2015
- Stratified Sampling Voxel Classification for Segmentation of Intraretinal and Subretinal Fluid in Longitudinal Clinical OCT DataIEEE Transactions on Medical Imaging, 2015
- jsPsych: A JavaScript library for creating behavioral experiments in a Web browserBehavior Research Methods, 2014
- Optical Coherence TomographyScience, 1991