An Image Turing Test on Realistic Gastroscopy Images Generated by Using the Progressive Growing of Generative Adversarial Networks
Open Access
- 13 March 2023
- journal article
- research article
- Published by Springer Nature in Journal of Digital Imaging
- Vol. 36 (4) , 1760-1769
Abstract
Generative adversarial networks (GAN) in medicine are valuable techniques for augmenting unbalanced rare data, anomaly detection, and avoiding patient privacy issues. However, there were limits to generating high-quality endoscopic images with various characteristics, such as peristalsis, viewpoints, light sources, and mucous patterns. This study used the progressive growing of GAN (PGGAN) within the normal distribution dataset to confirm the ability to generate high-quality gastrointestinal images and investigated what barriers PGGAN has to generate endoscopic images. We trained the PGGAN with 107,060 gastroscopy images from 4165 normal patients to generate highly realistic 5122 pixel-sized images. For the evaluation, visual Turing tests were conducted on 100 real and 100 synthetic images to distinguish the authenticity of images by 19 endoscopists. The endoscopists were divided into three groups based on their years of clinical experience for subgroup analysis. The overall accuracy, sensitivity, and specificity of the 19 endoscopist groups were 61.3%, 70.3%, and 52.4%, respectively. The mean accuracy of the three endoscopist groups was 62.4 [Group I], 59.8 [Group II], and 59.1% [Group III], which was not considered a significant difference. There were no statistically significant differences in the location of the stomach. However, the real images with the anatomical landmark pylorus had higher detection sensitivity. The images generated by PGGAN showed highly realistic depictions that were difficult to distinguish, regardless of their expertise as endoscopists. However, it was necessary to establish GANs that could better represent the rugal folds and mucous membrane texture.Keywords
Funding Information
- Korea Health Industry Development Institute (HI18C0022)
This publication has 31 references indexed in Scilit:
- Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic imagesGastric Cancer, 2018
- Deep Learning: A Primer for RadiologistsRadioGraphics, 2017
- Deep Learning in Medical Imaging: General OverviewKorean Journal of Radiology, 2017
- Characterization of Colorectal Lesions Using a Computer-Aided Diagnostic System for Narrow-Band Imaging EndocytoscopyGastroenterology, 2016
- The Miss Rate for Colorectal Adenoma Determined by Quality-Adjusted, Back-to-Back ColonoscopiesGut and Liver, 2012
- Two Years' Intensive Training in Endoscopic Diagnosis Facilitates Detection of Early Gastric CancerInternal Medicine, 2012
- An open-source software program for performing Bonferroni and related corrections for multiple comparisonsJournal of Pathology Informatics, 2011
- When do we miss synchronous gastric neoplasms with endoscopy?Gastrointestinal Endoscopy, 2010
- Kruskal‐Wallis Test2010
- Missed Diagnoses in Patients with Upper Gastrointestinal CancersEndoscopy, 2004