Comparison of self, nurse, and physician assessment of residents rotating through an intensive care unit
Authors:
- Bibiana CujecBCBibiana Cujec
- 1 November 1998
- journal article
- research article
- Published by Wolters Kluwer Health in Critical Care Medicine
- Vol. 26 (11) , 1811-1816
Abstract
Compare resident evaluations by self, nurses, and attending physicians. Prospective cohort. University intensive care unit. Sixty residents. End-rotational evaluation using a standardized, multiple-choice examination and one of two subjective instruments, Global Rating Scale and Behaviorally Anchored Rating Scale. Means for overall competence, using both the Behaviorally Anchored Rating Scale and the Global Rating Scale clustered between 3 to 4 on a 5-point scale. Physicians' evaluations correlated with the multiple-choice test scores (Spearman's rho 0.3082, p = .005, n = 82), whereas neither self-evaluation (Spearman's rho 0.1124, p = .65, n = 42) nor nurses' evaluations (Spearman's rho 0.2060, p = .069, n = 79) had a significant correlation with test scores. Spearman's correlations were not significant for either overall competence or specific medical knowledge by any category of evaluator using the Global Rating Scale. Spearman's rho correlations and kappa statistic between the three types of evaluators (physicians, nurses, and self) for each criterion of the Behaviorally Anchored Rating Scale demonstrated significant correlations between the ratings of physicians and nurses, except for the assessment of humanistic qualities. Pooled clinical skills-history taking (b = 0.277, p < .009), humanistic qualities (b = 0.607, p < .000), and professional attitudes and behavior (b = 0.488, p < .000) systematically differed in ratings comparing self with nurse and physician (by analysis of variance). The explanatory power of the model of ratings (independent variables of year of residency, category of evaluator, evaluation criteria, and interaction terms) was 47.3% (r2 adj). Self-rating by residents did not correlate to multiple-choice test scores and differed in some criteria with physicians' or nurses' evaluations. We found many similarities and some differences between physicians' and nurses' evaluations of residents. We speculate that different categories of evaluators assess different aspects of performance. Assessment by a varied group of evaluators should be used when attempts to predict future practice are made. (Crit Care Med 1998; 26:1811-1816)Keywords
This publication has 6 references indexed in Scilit:
- Anesthesia crisis resource management: Real-life simulation training in operating room crisesJournal of Clinical Anesthesia, 1995
- Technology assessment of anaesthesia monitors: problems and future directionsCanadian Journal of Anesthesia/Journal canadien d'anesthésie, 1995
- Comparing peer and faculty evaluations in an internal medicine residencyAcademic Medicine, 1994
- Issues in medical educationAcademic Medicine, 1993
- A Comprehensive Anesthesia Simulation EnvironmentAnesthesiology, 1988
- Sources of Assessment of Physician Performance: A Study of Comparative Reliability and Patterns of IntercorrelationMedical Care, 1981