Interobserver Variability and Cytotechnologist Performance in Digital Cervical Cytology: An International European Federation of Cytological Societies Study
- 29 October 2026
- journal article
- research article
- Published by Wiley in Cytopathology
Abstract
Background: Whole‐slide imaging (WSI) is increasingly incorporated into digital cervical cytology workflows; however, interpretive variability in borderline and low‐grade squamous lesions remains a recognized diagnostic challenge. This study evaluated interobserver agreement among cytotechnologists in WSI‐based cervical cytology, focusing on borderline and low‐grade squamous lesions. Methods: Sixty‐eight cervical cytology cases (31 ASC‐US, 19 NILM, 18 LSIL) were independently assessed by 19 cytotechnologists across two WSI‐based evaluation rounds. One participant was excluded due to incomplete evaluations in Round 1. Interobserver agreement was evaluated using Fleiss' kappa, Kendall's W , intraclass correlation coefficient, Krippendorff's alpha, Cronbach's alpha and Spearman rank correlation. Conclusions: Digital assessment using WSI demonstrated moderate interobserver agreement among cytotechnologists, with the greatest variability observed in ASC‐US cases. Repeated evaluation was associated with high internal consistency. Findings are compatible with interpretive variability; WSI‐specific effects cannot be excluded without a direct comparator. Paired rater medians did not differ significantly (4.38 vs. 4.00 min; p = 0.090).Keywords
This publication has 27 references indexed in Scilit:
- Artificial intelligence for colposcopic and cytological image analysis in early cervical cancer detectioniScience, 2026
- Implementing 100% quality control in a cervical cytology workflow using whole slide images and artificial intelligence provided by the Techcyte SureView™ SystemCancer Cytopathology, 2025
- Digital cytology part 1: digital cytology implementation for practice: a concept paper with review and recommendations from the American Society of Cytopathology Digital Cytology Task ForceJournal of the American Society of Cytopathology, 2023
- Validation of full-remote reporting for cervicovaginal cytology: the Caltagirone-Acireale distributed labJournal of the American Society of Cytopathology, 2023
- Inter‐ and intraobserver agreement in whole‐slide digital ThinPrep samples of low‐grade squamous lesions of the cervix uteri with known high‐risk HPV status: A multicentric international studyCancer Cytopathology, 2022
- Summary measures of agreement and association between many raters' ordinal classificationsAnnals of Epidemiology, 2017
- Bethesda Interobserver Reproducibility Study-2 (BIRST-2): Bethesda System 2014Journal of the American Society of Cytopathology, 2017
- HPV DNA testing with cytology triage in cervical cancer screening: Influence of revealing HPV infection statusCancer Cytopathology, 2015
- Interobserver Reproducibility of Cervical Cytologic and Histologic InterpretationsRealistic Estimates From the ASCUS-LSIL Triage StudyJAMA, 2001
- Coefficient Alpha and the Internal Structure of TestsPsychometrika, 1951