Automatic interpretation and clinical evaluation for fundus fluorescein angiography images of diabetic retinopathy patients by deep learning
Authors:
- 28 September 2022
- journal article
- research article
- Published by BMJ in British Journal of Ophthalmology
- Vol. 107 (12) , 1852-1858
Abstract
Background/aims Fundus fluorescein angiography (FFA) is an important technique to evaluate diabetic retinopathy (DR) and other retinal diseases. The interpretation of FFA images is complex and time-consuming, and the ability of diagnosis is uneven among different ophthalmologists. The aim of the study is to develop a clinically usable multilevel classification deep learning model for FFA images, including prediagnosis assessment and lesion classification. Methods A total of 15 599 FFA images of 1558 eyes from 845 patients diagnosed with DR were collected and annotated. Three convolutional neural network (CNN) models were trained to generate the label of image quality, location, laterality of eye, phase and five lesions. Performance of the models was evaluated by accuracy, F-1 score, the area under the curve and human-machine comparison. The images with false positive and false negative results were analysed in detail. Results Compared with LeNet-5 and VGG16, ResNet18 got the best result, achieving an accuracy of 80.79%–93.34% for prediagnosis assessment and an accuracy of 63.67%–88.88% for lesion detection. The human-machine comparison showed that the CNN had similar accuracy with junior ophthalmologists. The false positive and false negative analysis indicated a direction of improvement. Conclusion This is the first study to do automated standardised labelling on FFA images. Our model is able to be applied in clinical practice, and will make great contributions to the development of intelligent diagnosis of FFA images.Keywords
Funding Information
- National Natural Science Foundation of China (U20A20386)
- National Key Research and Development Program of China (2019YFC0118400)
- Clinical Medical Research Center for Eye Diseases of Zhejiang Province (2021E50007)
- Key Research and Development Program of Zhejiang Province (2019C03020)
- Medical and Health Science and Technology Program of Zhejiang Province (2021RC064)
This publication has 28 references indexed in Scilit:
- Deep Learning Classifiers for Automated Detection of Gonioscopic Angle Closure Based on Anterior Segment OCT ImagesAmerican Journal of Ophthalmology, 2019
- Imaging and Biomarkers in Diabetic Macular Edema and Diabetic RetinopathyCurrent Diabetes Reports, 2019
- Using a Deep Learning Algorithm and Integrated Gradients Explanation to Assist Grading for Diabetic RetinopathyOphthalmology, 2019
- Color Fundus Photography, Optical Coherence Tomography, and Fluorescein Angiography in Diagnosing Polypoidal Choroidal VasculopathyAmerican Journal of Ophthalmology, 2018
- Optical coherence tomography angiographyProgress in Retinal and Eye Research, 2018
- Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus PhotographsJAMA, 2016
- Deep Residual Learning for Image Recognition2016
- Contemporary retinal imaging techniques in diabetic retinopathy: a reviewClinical & Experimental Ophthalmology, 2016
- Fully Automatic Segmentation of Fluorescein Leakage in Subjects With Diabetic Macular EdemaInvestigative Ophthalmology & Visual Science, 2015
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998