Reliability of retinal pathology quantification in age-related macular degeneration: Implications for clinical trials and machine learning applications
Authors:
- Philipp L. MüllerPMPhilipp L. Müller
- Bart LiefersBLBart Liefers
- Tim TreisTTTim Treis
- Filipa Gomes RodriguesFRFilipa Gomes Rodrigues
- Abraham Olvera-BarriosAOAbraham Olvera-Barrios
- Bobby PaulBPBobby Paul
- Narendra DhingraNDNarendra Dhingra
- Andrew LoteryALAndrew Lotery
- Clare BaileyCBClare Bailey
- Paul TaylorPTPaul Taylor
- Clarisa I. SánchezCSClarisa I. Sánchez
- Adnan TufailATAdnan Tufail
Preprint
Abstract
Purpose: To investigate the inter-reader agreement for grading of retinal alterations in age-related macular degeneration (AMD) using a reading center setting. Methods: In this cross-sectional case series, spectral domain optical coherence tomography (OCT, Topcon 3D OCT, Tokyo, Japan) scans of 112 eyes of 112 patients with neovascular AMD (56 treatment-naive, 56 after three anti-vascular endothelial growth factor injections) were analyzed by four independent readers. Imaging features specific for AMD were annotated using a novel custom-built annotation platform. Dice score, Bland-Altman plots, coefficients of repeatability (CR), coefficients of variation (CV), and intraclass correlation coefficients (ICC) were assessed. Results: Loss of ellipsoid zone, pigment epithelium detachment, subretinal fluid, and Drusen were the most abundant features in our cohort. The features subretinal fluid, intraretinal fluid, hypertransmission, descent of the outer plexiform layer, and pigment epithelium detachment showed highest inter-reader agreement, while detection and measures of loss of ellipsoid zone and retinal pigment epithelium were more variable. The agreement on the size and location of the respective annotation was more consistent throughout all features. Conclusions: The inter-reader agreement depended on the respective OCT-based feature. A selection of reliable features might provide suitable surrogate markers for disease progression and possible treatment effects focusing on different disease stages. Translational Relevance: This might give opportunities to a more time- and cost-effective patient assessment and improved decision-making as well as have implications for clinical trials and training machine learning algorithms.Keywords
All Related Versions
- Published version: Translational Vision Science & Technology, 10 (3), 4.
This publication has 59 references indexed in Scilit:
- Clinical study protocol for a low-interventional study in intermediate age-related macular degeneration developing novel clinical endpoints for interventional clinical trials with a regulatory and patient access intention—MACUSTARTrials, 2020
- Emixustat Hydrochloride for Geographic Atrophy Secondary to Age-Related Macular DegenerationOphthalmology, 2018
- Efficacy and Safety of Lampalizumab for Geographic Atrophy Due to Age-Related Macular DegenerationJAMA Ophthalmology, 2018
- Global causes of blindness and distance vision impairment 1990–2020: a systematic review and meta-analysisThe Lancet Global Health, 2017
- Anatomic Clinical Trial Endpoints for Nonexudative Age-Related Macular DegenerationOphthalmology, 2016
- Geographic AtrophyOphthalmology, 2014
- Present and Possible Therapies for Age-Related Macular DegenerationISRN Ophthalmology, 2014
- Recent developments in the treatment of age-related macular degenerationJournal of Clinical Investigation, 2014
- Report from the NEI/FDA Ophthalmic Clinical Trial Design and Endpoints Symposium*Investigative Ophthalmology & Visual Science, 2008
- Pathogenesis of lesions in late age-related macular diseaseAmerican Journal of Ophthalmology, 2004