Entropy and expertise: assessing changes in pathologists' language over time using the UK Liver Pathology External Quality Assessment scheme
Open Access
- 13 June 2025
- journal article
- Published by Wiley in The Journal of Pathology: Clinical Research
- Vol. 11 (4) , e70032
Abstract
External Quality Assessment (EQA) schemes are an important quality assurance tool and aim to ensure consistency among histopathologists. In this study, we use Shannon entropy as a novel metric to evaluate linguistic variability in the UK Liver Pathology EQA scheme. Analysing free‐text responses by participants over a decade, we aimed to quantify language trends in morphological assessments and clinicopathological diagnoses. Accounting for an increasing word count and when pathologists joined the scheme, our findings reveal a significant increase in entropy of morphological assessments over time, indicating growing linguistic diversity that may reflect the increasing complexity of liver pathology. Entropy of clinicopathological diagnoses over the same period did not provide clear evidence for convergent diagnostic language. High entropy corresponded to cases that elicited more diverse responses and could be considered more challenging, highlighting the utility of this method to identify potential areas for targeted education. We demonstrate entropy as a novel tool to analyse pathologist language and enhance quality assurance in the evolving pathology landscape.Keywords
This publication has 14 references indexed in Scilit:
- Application of Artificial Intelligence in Pathology: Trends and ChallengesDiagnostics, 2022
- Pathology of liver disease: advances in the last 50 yearsHuman Pathology, 2020
- Hepatic Epithelioid HemangioendotheliomaArchives of Pathology & Laboratory Medicine, 2018
- Review of the national external quality assessment (EQA) scheme for breast pathology in the UKJournal of Clinical Pathology, 2016
- Diagnosis and differential diagnosis of hepatic graft versus host disease (GVHD)2016
- Measuring interobserver variation in a pathology EQA scheme using weighted κ for multiple readersJournal of Clinical Pathology, 2011
- External quality assessment slide schemes: pathologists’ experiences and perceptionsJournal of Clinical Pathology, 2006
- The NHS breast screening programme (pathology) EQA: experience in recent years relating to issues involved in individual performance appraisalJournal of Clinical Pathology, 2006
- Are external quality assurance (EQA) slide schemes a valid tool for the performance assessment of histopathologists?Pathology - Research and Practice, 2005
- Phraseology in pathology reports. A comparative study of interpretation among pathologists and surgeons.Journal of Clinical Pathology, 1996