Understanding inherent image features in CNN-based assessment of diabetic retinopathy
Authors:
Open Access
- 6 May 2021
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 11 (1) , 1-12
Abstract
Diabetic retinopathy (DR) is a leading cause of blindness and affects millions of people throughout the world. Early detection and timely checkups are key to reduce the risk of blindness. Automated grading of DR is a cost-effective way to ensure early detection and timely checkups. Deep learning or more specifically convolutional neural network (CNN)—based methods produce state-of-the-art performance in DR detection. Whilst CNN based methods have been proposed, no comparisons have been done between the extracted image features and their clinical relevance. Here we first adopt a CNN visualization strategy to discover the inherent image features involved in the CNN’s decision-making process. Then, we critically analyze those features with respect to commonly known pathologies namely microaneurysms, hemorrhages and exudates, and other ocular components. We also critically analyze different CNNs by considering what image features they pick up during learning to predict and justify their clinical relevance. The experiments are executed on publicly available fundus datasets (EyePACS and DIARETDB1) achieving an accuracy of 89 ~ 95% with AUC, sensitivity and specificity of respectively 95 ~ 98%, 74 ~ 86%, and 93 ~ 97%, for disease level grading of DR. Whilst different CNNs produce consistent classification results, the rate of picked-up image features disagreement between models could be as high as 70%.Keywords
Funding Information
- Novo Nordisk Fonden (NFF14CC0001)
This publication has 39 references indexed in Scilit:
- Application of Random Forests Methods to Diabetic Retinopathy Classification AnalysesPLOS ONE, 2014
- LBP and Machine Learning for Diabetic Retinopathy Detection2014
- DREAM: Diabetic Retinopathy Analysis Using Machine LearningIEEE Journal of Biomedical and Health Informatics, 2013
- Causes of vision loss worldwide, 1990–2010: a systematic analysisThe Lancet Global Health, 2013
- Agreement and reasons for disagreement between photographic and hospital biomicroscopy grading of diabetic retinopathyDiabetic Medicine, 2011
- Diabetic retinopathyThe Lancet, 2010
- Automated Identification of Diabetic Retinopathy Stages Using Digital Fundus ImagesJournal of Medical Systems, 2007
- the DIARETDB1 diabetic retinopathy database and evaluation protocol2007
- Survey over image thresholding techniques and quantitative performance evaluationJournal of Electronic Imaging, 2004
- A helicopter-borne eight-channel ranging scatterometer for remote sensing. II. Forest inventoryIEEE Transactions on Geoscience and Remote Sensing, 1993