Cohen’s Linearly Weighted Kappa is a Weighted Average of 2×2 Kappas
- 1 July 2011
- journal article
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 76 (3) , 471-486
Abstract
An agreement table with n∈ℕ≥3 ordered categories can be collapsed into n−1 distinct 2×2 tables by combining adjacent categories. Vanbelle and Albert (Stat. Methodol. 6:157–163, 2009c) showed that the components of Cohen’s weighted kappa with linear weights can be obtained from these n−1 collapsed 2×2 tables. In this paper we consider several consequences of this result. One is that the weighted kappa with linear weights can be interpreted as a weighted arithmetic mean of the kappas corresponding to the 2×2 tables, where the weights are the denominators of the 2×2 kappas. In addition, it is shown that similar results and interpretations hold for linearly weighted kappas for multiple raters.Keywords
This publication has 44 references indexed in Scilit:
- On Similarity Coefficients for 2×2 Tables and Correction for ChancePsychometrika, 2008
- THE EXACT VARIANCE OF WEIGHTED KAPPA WITH MULTIPLE RATERSPsychological Reports, 2007
- Kappa coefficients in medical researchStatistics in Medicine, 2002
- A Generalization of Cohen's Kappa Agreement Measure to Interval Measurement and Multiple RatersEducational and Psychological Measurement, 1988
- Coefficient Kappa: Some Uses, Misuses, and AlternativesEducational and Psychological Measurement, 1981
- The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of ReliabilityEducational and Psychological Measurement, 1973
- Measuring nominal scale agreement among many raters.Psychological Bulletin, 1971
- Large sample standard errors of kappa and weighted kappa.Psychological Bulletin, 1969
- VARIABILITY IN CLASSIFICATION OF CARCINOMA IN SITU OF THE UTERINE CERVIXObstetrical & Gynecological Survey, 1968
- Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.Psychological Bulletin, 1968