Interval Estimation of the Kappa Coefficient with Binary Classification and an Equal Marginal Probability Model
Author:
- 1 June 2000
- journal article
- research article
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 56 (2) , 583-585
Abstract
Summary. We derive a likelihood score method for interval estimation of the intraclass version of the kappa coefficient of agreement with binary classification using a general theory of Bartlett (1953, Biometrika40, 306–317). By exact evaluation, we investigate statistical properties of the score method, the chi‐square goodness‐of‐fit procedure (Donner and Eliasziw, 1992, Statistics in Medicine11, 1511–1519; Hale and Fleiss, 1993, Biometrics49, 523–534), and a crude confidence interval for small and medium sample sizes. Actual coverage percentages of the score and chi‐square methods are satisfactorily close to the nominal confidence coefficient, while that of the crude method is quite unsatisfactory. The expected length of the score method is shorter than that of the chi‐square procedure when the response rate is very small or very large.Keywords
This publication has 8 references indexed in Scilit:
- Interval Estimation under Two Study Designs for Kappa with Binary Classifications1993
- A goodness‐of‐fit approach to inference procedures for the kappa statistic: Confidence interval construction, significance‐testing and sample size estimationStatistics in Medicine, 1992
- Approximate Interval Estimation of the Ratio of Binomial Parameters: A Review and Corrections for SkewnessBiometrics, 1988
- Theoretical Statistics1974
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960
- Reliability of Content Analysis: The Case of Nominal Scale CodingPublic Opinion Quarterly, 1955
- Approximate Confidence Intervals.II. More than one Unknown ParameterBiometrika, 1953
- APPROXIMATE CONFIDENCE INTERVALSBiometrika, 1953