Measuring Physicians’ Performance in Clinical Practice: Reliability, Classification Accuracy, and Validity
Authors:
- 27 August 2010
- journal article
- research article
- Published by SAGE Publications in Evaluation & the Health Professions
- Vol. 33 (3) , 302-320
Abstract
Much research has been devoted to addressing challenges in achieving reliable assessments of physicians’ clinical performance but less work has focused on whether valid and accurate classification decisions are feasible. This study used 957 physicians certified in internal medicine (IM) or a subspecialty, who completed the American Board of Internal Medicine (ABIM) Diabetes Practice Improvement Module (PIM). Ten clinical and two patient-experience measures were aggregated into a composite measure. The composite measure score was highly reliable (r = .91) and classification accuracy was high across the entire score scale (>0.90), which indicated that it is possible to differentiate high-performing and low-performing physicians. Physicians certified in endocrinology and those who scored higher on their IM certification examination had higher composite scores, providing some validity evidence. In summary, it is feasible to create a psychometrically robust composite measure of physicians’ clinical performance, specifically for the quality of care they provide to patients with diabetes.Keywords
This publication has 24 references indexed in Scilit:
- How Can We Make More Progress In Measuring Physicians’ Performance To Improve The Value Of Care?Health Affairs, 2009
- Classification Consistency and Accuracy for Complex Assessments Under the Compound Multinomial ModelApplied Psychological Measurement, 2009
- Improving the Reliability of Physician Performance AssessmentMedical Care, 2009
- Standards of Medical Care in Diabetes—2009Diabetes Care, 2009
- Exclusion of Patients from Pay-for-Performance Targets by English PhysiciansNew England Journal of Medicine, 2008
- Self-assessment of practice performance: Development of the ABIM Practice Improvement Module (PIMSM)Journal of Continuing Education in the Health Professions, 2008
- Combining Multiple Indicators of Clinical QualityMedical Care, 2007
- Pay-for-PerformanceJAMA, 2007
- Pay for Performance at the Tipping PointNew England Journal of Medicine, 2007
- The Effects of Patient Volume on the Quality of Diabetic Care for Medicare BeneficiariesMedical Care, 2006