Conditional inference for subject‐specific and marginal agreement: Two families of agreement measures
Authors:
- 18 December 1995
- journal article
- Published by Wiley in Canadian Journal of Statistics
- Vol. 23 (4) , 333-344
Abstract
A two‐stage procedure is described for assessing subject‐specific and marginal agreement for data from a test‐retest reliability study of a binary classification procedure. Subject‐specific agreement is parametrized through the log odds ratio, while marginal agreement is reflected by the log ratio of the off‐diagonal Poisson means. A family of agreement measures in the interval [‐1, 1] is presented for both types of agreement. The conditioning argument described facilitates exact inference. The proposed methodology is demonstrated by way of an example involving hypothetical data chosen for illustrative purposes, and data from a National Health Survey Study (Rogot and Goldberg 1966).Keywords
This publication has 24 references indexed in Scilit:
- The Difference Between Two Normal MeansThe American Statistician, 1993
- Zero-Inflated Poisson Regression, with an Application to Defects in ManufacturingTechnometrics, 1992
- Use of the Log Odds Ratio to Assess the Reliability of Dichotomous Questionnaire DataApplied Psychological Measurement, 1987
- A Re-analysis of the Reliability of Psychiatric DiagnosisThe British Journal of Psychiatry, 1974
- The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of ReliabilityEducational and Psychological Measurement, 1973
- Large sample standard errors of kappa and weighted kappa.Psychological Bulletin, 1969
- Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.Psychological Bulletin, 1968
- A proposed index for measuring agreement in test-retest studiesJournal of Chronic Diseases, 1966
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960
- On the Methods of Measuring Association Between Two AttributesJournal of the Royal Statistical Society, 1912