Automated segmentation and feature discovery of age-related macular degeneration and Stargardt disease via self-attended neural networks
Open Access
- 26 August 2022
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 12 (1) , 1-11
Abstract
Age-related macular degeneration (AMD) and Stargardt disease are the leading causes of blindness for the elderly and young adults respectively. Geographic atrophy (GA) of AMD and Stargardt atrophy are their end-stage outcomes. Efficient methods for segmentation and quantification of these atrophic lesions are critical for clinical research. In this study, we developed a deep convolutional neural network (CNN) with a trainable self-attended mechanism for accurate GA and Stargardt atrophy segmentation. Compared with traditional post-hoc attention mechanisms which can only visualize CNN features, our self-attended mechanism is embedded in a fully convolutional network and directly involved in training the CNN to actively attend key features for enhanced algorithm performance. We applied the self-attended CNN on the segmentation of AMD and Stargardt atrophic lesions on fundus autofluorescence (FAF) images. Compared with a preexisting regular fully convolutional network (the U-Net), our self-attended CNN achieved 10.6% higher Dice coefficient and 17% higher IoU (intersection over union) for AMD GA segmentation, and a 22% higher Dice coefficient and a 32% higher IoU for Stargardt atrophy segmentation. With longitudinal image data having over a longer time, the developed self-attended mechanism can also be applied on the visual discovery of early AMD and Stargardt features.Keywords
Funding Information
- National Eye Institute (R21EY030619)
This publication has 32 references indexed in Scilit:
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Multimodal Registration of Multiple Retinal Images Based on Line Structures2015
- Automated segmentation of geographic atrophy in fundus autofluorescence images using supervised pixel classificationJournal of Medical Imaging, 2015
- AUTOMATED IMAGE ALIGNMENT AND SEGMENTATION TO FOLLOW PROGRESSION OF GEOGRAPHIC ATROPHY IN AGE-RELATED MACULAR DEGENERATIONRetina, 2014
- Segmentation of the Geographic Atrophy in Spectral-Domain Optical Coherence Tomography and Fundus Autofluorescence ImagesInvestigative Ophthalmology & Visual Science, 2013
- Semi-automatic geographic atrophy segmentation for SD-OCT imagesBiomedical Optics Express, 2013
- Semiautomated Image Processing Method for Identification and Quantification of Geographic Atrophy in Age-Related Macular DegenerationInvestigative Ophthalmology & Visual Science, 2011
- Age-related macular degenerationThe Lancet, 2008
- FUNDUS AUTOFLUORESCENCE IMAGINGRetina, 2008
- Changes in Visual Acuity in a Population Over a 15-year Period: The Beaver Dam Eye StudyAmerican Journal of Ophthalmology, 2006