Interobserver and Intertest Agreement in Telemedicine Glaucoma Screening with Optic Disk Photos and Optical Coherence Tomography
Authors:
- Alfonso AntonAAAlfonso Anton
- Karen NolivosKNKaren Nolivos
- Marta PazosMPMarta Pazos
- Gianluca FattiGFGianluca Fatti
- Alejandra HerranzAHAlejandra Herranz
- Miriam Eleonora Ayala-FuentesMAMiriam Eleonora Ayala-Fuentes
- Elena Martínez-PratsEMElena Martínez-Prats
- Oscar PeralOPOscar Peral
- Zaida Vega-LopezZVZaida Vega-Lopez
- Antoni Monleon-GetinoAMAntoni Monleon-Getino
- Antonio Morilla-GrasaAMAntonio Morilla-Grasa
- Merce ComasMCMerce Comas
Open Access
- 28 July 2021
- journal article
- research article
- Published by MDPI AG in Journal of Clinical Medicine
- Vol. 10 (15) , 3337
Abstract
Purpose: To evaluate interobserver and intertest agreement between optical coherence tomography (OCT) and retinography in the detection of glaucoma through a telemedicine program. Methods: A stratified sample of 4113 individuals was randomly selected, and those who accepted underwent examination including visual acuity, intraocular pressure (IOP), non-mydriatic retinography, and imaging using a portable OCT device. Participants’ data and images were uploaded and assessed by 16 ophthalmologists on a deferred basis. Two independent evaluations were performed for all participants. Agreement between methods was assessed using the kappa coefficient and the prevalence-adjusted bias-adjusted kappa (PABAK). We analyzed potential factors possibly influencing the level of agreement. Results: The final sample comprised 1006 participants. Of all suspected glaucoma cases (n = 201), 20.4% were identified in retinographs only, 11.9% in OCT images only, 46.3% in both, and 21.4% were diagnosed based on other data. Overall interobserver agreement outcomes were moderate to good with a kappa coefficient of 0.37 and a PABAK index of 0.58. Higher values were obtained by experienced evaluators (kappa = 0.61; PABAK = 0.82). Kappa and PABAK values between OCT and photographs were 0.52 and 0.82 for the first evaluation. Conclusion: In a telemedicine screening setting, interobserver agreement on diagnosis was moderate but improved with greater evaluator expertise.Keywords
Funding Information
- Fondo de Investigaciones Sanitarias of the Spanish Ministry of Health (PI15/00412)
This publication has 24 references indexed in Scilit:
- Cambridge community Optometry Glaucoma SchemeClinical & Experimental Ophthalmology, 2014
- Enhanced Detection of Open-angle Glaucoma with an Anatomically Accurate Optical Coherence Tomography–Derived Neuroretinal Rim ParameterOphthalmology, 2013
- The Validity of Screening For Open-angle Glaucoma in High-risk Populations With Single-test Screening Mode Frequency Doubling Technology Perimetry (FDT)Journal of Glaucoma, 2011
- Screening Tests for Detecting Open-Angle Glaucoma: Systematic Review and Meta-analysisInvestigative Ophthalmology & Visual Science, 2008
- Sensitivity and specificity of frequency‐doubling technology, tendency‐oriented perimetry, SITA Standard and SITA Fast perimetry in perimetrically inexperienced individualsActa Ophthalmologica Scandinavica, 2006
- Prevalence of Primary Open-Angle Glaucoma in a Spanish PopulationJournal of Glaucoma, 2004
- Beyond kappa: A review of interrater agreement measuresCanadian Journal of Statistics, 1999
- Improving the sensitivity of the OKP visual field screening test with a blue stimulus on a dark backgroundEye, 1996
- Bias, prevalence and kappaJournal of Clinical Epidemiology, 1993
- High agreement but low Kappa: I. the problems of two paradoxesJournal of Clinical Epidemiology, 1990