A Multivariate Generalizability Model for Clinical Skills Assessments
Authors:
- 1 February 2004
- journal article
- other
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 64 (1) , 22-39
Abstract
Assessments of clinical skills of medical students rely increasingly on standardized patients demonstrating medical cases with faculty rating performance. The common finding of inconsistency of scores across cases is often referred to as case specificity. A multivariate generalizability model reveals that overall case specificity cannot explain inconsistency in this example. Results from the multivariate model suggest directions for enhancing the table of specifications, optimizing scoring, and improving case selection to reduce inconsistency in scores across cases.Keywords
This publication has 31 references indexed in Scilit:
- Estimating Reliability Under a Generalizability Theory Model for Test Scores Composed of TestletsApplied Measurement in Education, 1999
- How Reliable are TOEFL Scores?Educational and Psychological Measurement, 1997
- Assessing clinical performance with standardized patientsJAMA, 1997
- Estimating variance components in generalizability theory: The covariance structure analysis approachStructural Equation Modeling: A Multidisciplinary Journal, 1996
- Interrater Reliability ReconsideredEvaluation & the Health Professions, 1994
- On the Reliability of Testlet‐Based TestsJournal of Educational Measurement, 1991
- Assessment of clinical skills with standardized patients: State of the artTeaching and Learning in Medicine, 1990
- Factors influencing reproducibility of tests using standardized patientsTeaching and Learning in Medicine, 1989
- Reliability of performance on standardized patient cases: A comparison of consistency measures based on generalizability theoryTeaching and Learning in Medicine, 1989
- Obtaining Generalizability Coefficients for Clinical EvaluationsEvaluation & the Health Professions, 1982