An application of kappa‐type analyses to interobserver variation in classifying chest radiographs for pneumoconiosis
- 1 January 1984
- journal article
- Published by Wiley in Statistics in Medicine
- Vol. 3 (1) , 73-83
Abstract
We investigated interobserver variation between three physician readers in the independent classification of chest radiographs from 1771 taconite workers for pneumoconiosis. We analysed variation with a general methodology for the analysis of categorical data, and quantified interobserver agreement in terms of kappatype statistics. The results revealed considerable variation in the profusion of opacities reported by each observer. This was especially so for the earliest radiographic changes, but variation also occurred with the small number of films in the series showing category 2 pneumoconiosis or over. Variation in the classification of profusion of small opacities was greater in films of poor quality, and also increased with the length of time between taking and reading the film (film age). We could not account for the effect of film age by controlling for film quality, as subjectively assessed by the readers.Keywords
This publication has 14 references indexed in Scilit:
- Proficiency examination of physicians for classifying pneumoconiosis chest filmsAmerican Journal of Roentgenology, 1979
- Improving Performance by Multiple Interpretations of Chest Radiographs: Effectiveness and CostRadiology, 1978
- An Application of Hierarchical Kappa-type Statistics in the Assessment of Majority Agreement among Multiple ObserversBiometrics, 1977
- The Measurement of Observer Agreement for Categorical DataBiometrics, 1977
- A computer program for the generalized chi-square analysis of categorical data using weighted least squares (GENCAT)Computer Programs in Biomedicine, 1976
- The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of ReliabilityEducational and Psychological Measurement, 1973
- Observations on the Results of Multiple Readings of Chest Films in Coal Miners' PneumoconiosisRadiology, 1973
- THE EFFECT OF FILM QUALITY AND OTHER FACTORS ON THE ROENTGENOGRAPHIC CATEGORIZATION OF COAL WORKERS’ PNEUMOCONIOSISAmerican Journal of Roentgenology, 1972
- Large sample standard errors of kappa and weighted kappa.Psychological Bulletin, 1969
- OBSERVER ERROR IN THE INTERPRETATION OF CHEST FILMSThe Lancet, 1952