Obtaining Generalizability Coefficients for Clinical Evaluations
Authors:
Open Access
- 1 September 1982
- journal article
- research article
- Published by SAGE Publications in Evaluation & the Health Professions
- Vol. 5 (3) , 345-358
Abstract
This article discusses the determination of reliability coefficients for clinical evaluation forms by use of generalizability theory. This method is contrasted to some of the commonly used measures of interobserver agreement, interobserver reliability, and classical reliability. The value of this method in terms of making recommendations, such as the number ofjudges and the number of items on a form, in order to improve reliability is illustrated by two examples. Also, the difference between norm-referenced decisions and criterion-referenced decisions in determining reliability with this method is presented.Keywords
This publication has 10 references indexed in Scilit:
- MULTIVARIATE GENERALIZABILITY OF GENERAL EDUCATIONAL DEVELOPMENT RATINGSJournal of Educational Measurement, 1981
- AN INDEX OF DEPENDABILITY FOR MASTERY TESTSJournal of Educational Measurement, 1977
- The Measurement of Observer Agreement for Categorical DataBiometrics, 1977
- A REVIEW OF THE OBSERVATIONAL DATA‐COLLECTION AND RELIABILITY PROCEDURES REPORTED IN THE JOURNAL OF APPLIED BEHAVIOR ANALYSISJournal of Applied Behavior Analysis, 1977
- Measuring Agreement between Two Judges on the Presence or Absence of a Trait1975
- Generalizability of Scores Influenced by Multiple Sources of VariancePsychometrika, 1965
- THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†British Journal of Statistical Psychology, 1963
- Average Values of Mean Squares in FactorialsThe Annals of Mathematical Statistics, 1956
- Estimation of the Reliability of RatingsPsychometrika, 1951
- Theory of mental tests.1950