Definitions and Standardization of a New Grading Scheme for Eyelid Contour Abnormalities after Trichiasis Surgery

Authors:

Abstract
Clear definitions of outcomes following trichiasis surgery are critical for planning program evaluations and for identifying ways to improve trichiasis surgery. Eyelid contour abnormality is an important adverse outcome of surgery; however, no standard method has been described to categorize eyelid contour abnormalities. A classification system for eyelid contour abnormalities following surgery for trachomatous trichiasis was developed. To determine whether the grading was reproducible using the classification system, six-week postoperative photographs were reviewed by two senior graders to characterize severity of contour abnormalities. Sample photographs defining each contour abnormality category were compiled and used to train four new graders. All six graders independently graded a Standardization Set of 75 eyelids, which included a roughly equal distribution across the severity scale, and weighted kappa scores were calculated. Two hundred forty six-week postoperative photographs from an ongoing clinical trial were randomly selected for evaluating agreement across graders. Two months after initial grading, one grader regraded a subset of the 240 photographs to measure longer-term intra-observer agreement. The weighted kappa for agreement between the two senior graders was 0.80 (95% CI: 0.71–0.89). Among the Standardization Set, agreement between the senior graders and the 4 new graders showed weighted kappa scores ranging from 0.60–0.80. Among 240 eyes comprising the clinical trial dataset, agreement ranged from weighted kappa 0.70–0.71. Longer-term intra-observer agreement was weighted kappa 0.86 (95% CI: 0.80–0.92). The standard eyelid contour grading system we developed reproducibly delineates differing levels of contour abnormality. This grading system could be useful both for helping to evaluate trichiasis surgery outcomes in clinical trials and for evaluating trichiasis surgery programs. Approximately 8 million individuals worldwide suffer from trichiasis, a condition characterized by in-turned lashes that rub against the eye. Trichiasis is caused by repeated or prolonged ocular infection with Chlamydia trachomatis. Surgery is available to correct in-turned lashes. In most programmatic and research settings, the primary determinant of surgical success is whether or not lashes are touching the globe post-operatively. However, other surgical outcomes such as the contour of the eyelid are also important. Yet, no standard method for evaluating and reporting this outcome has been defined. In this study, we developed and tested a grading system for evaluating the severity of eyelid contour abnormalities after surgery using photographs of eyelids six weeks post-operatively. We found good agreement across photograph graders and also between field and photograph grades. This system should be useful in helping to standardize reporting of this outcome.

This publication has 20 references indexed in Scilit: