Determining the Number of Patient Charts Necessary for a Reliable Assessment of Practicing Family Physicians’ Performance
Authors:
- 17 February 2010
- journal article
- research article
- Published by SAGE Publications in Evaluation & the Health Professions
- Vol. 33 (1) , 109-122
Abstract
In many countries, peer assessment programs based on the examination of patient charts are becoming a standard to assess physician’s clinical performance. Although data on validity of the process are acceptable, reliability issues need some improvement. This article addresses the rarely studied aspect of optimal number of patient charts for an acceptable reliable assessment. Fifteen patient charts for each of a group of 20 practicing physicians were independently reviewed by 4 professional peer assessors. Generalizability (G) and decision (D) studies were applied to the data. It appears that as few as 10 patient charts are sufficient for any assessor to obtain a G coefficient of 0.80. Results of the current study suggest the possibility of getting generalizable assessments by peer reviewer with minimal information. These results are not in accordance with the concept of case specificity in which it is claimed that performance on a case is a poor predictor of performance on a different case.Keywords
This publication has 17 references indexed in Scilit:
- Assessment of Family Physicians' Performance Using Patient ChartsEvaluation & the Health Professions, 2007
- Case Specificity: Empirical Phenomenon or Measurement Artifact?Teaching and Learning in Medicine, 2007
- Is the script concordance test a valid instrument for assessment of intraoperative decision-making skills?The American Journal of Surgery, 2007
- Influence of remedial professional development programs for poorly performing physiciansJournal of Continuing Education in the Health Professions, 2007
- How specific is case specificity?Medical Education, 2006
- Feasibility and psychometric properties of using peers, consulting physicians, co-workers, and patients to assess physiciansAcademic Medicine, 1997
- Chart ReviewEvaluation & the Health Professions, 1997
- Comparison of patient questionnaire, medical record, and audio tape in assessment of health promotion in general practice consultationsBMJ, 1994
- The Reliability of Peer AssessmentsEvaluation & the Health Professions, 1994
- Case Specificity of Standardized-Patient ExaminationsEvaluation & the Health Professions, 1990