Influence of Different Types of Retinal Cameras on the Performance of Deep Learning Algorithms in Diabetic Retinopathy Screening
Open Access
Abstract
Background: The aim of this study was to assess the performance of regional graders and artificial intelligence algorithms across retinal cameras with different specifications in classifying an image as gradable and ungradable. Methods: Study subjects were included from a community-based nationwide diabetic retinopathy screening program in Thailand. Various non-mydriatic fundus cameras were used for image acquisition, including Kowa Nonmyd, Kowa Nonmyd α-DⅢ, Kowa Nonmyd 7, Kowa Nonmyd WX, Kowa VX 10 α, Kowa VX 20 and Nidek AFC 210. All retinal photographs were graded by deep learning algorithms and human graders and compared with a standard reference. Results: Images were divided into two categories as gradable and ungradable images. Four thousand eight hundred fifty-two participants with 19,408 fundus images were included, of which 15,351 (79.09%) were gradable images and the remaining 4057 (20.90%) were ungradable images. Conclusions: The deep learning (DL) algorithm demonstrated better sensitivity, specificity and kappa than the human graders for all eight types of non-mydriatic fundus cameras. The deep learning system showed, more consistent diagnostic performance than the human graders across images of varying quality and camera types.Keywords
This publication has 10 references indexed in Scilit:
- Pivotal Evaluation of an Artificial Intelligence System for Autonomous Detection of Referrable and Vision-Threatening Diabetic RetinopathyJAMA Network Open, 2021
- Automated diabetic retinopathy detection with two different retinal imaging devices using artificial intelligence: a comparison studyGraefe's Archive for Clinical and Experimental Ophthalmology, 2020
- Evaluation of an AI system for the detection of diabetic retinopathy from images captured with a handheld portable fundus camera: the MAILOR AI studyEye, 2020
- Estimated number of ophthalmologists worldwide (International Council of Ophthalmology update): will we meet the needs?British Journal of Ophthalmology, 2019
- Deep learning versus human graders for classifying diabetic retinopathy severity in a nationwide screening programnpj Digital Medicine, 2019
- Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care officesnpj Digital Medicine, 2018
- IDF Diabetes Atlas: Global estimates of diabetes prevalence for 2017 and projections for 2045Diabetes Research and Clinical Practice, 2018
- Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With DiabetesJAMA, 2017
- Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus PhotographsJAMA, 2016
- Artificial Intelligence With Deep Learning Technology Looks Into Diabetic Retinopathy ScreeningJAMA, 2016