Assessing Residents’ Competencies at Baseline: Identifying the Gaps
Authors:
- Monica L. LypsonMLMonica L. Lypson
- John G. FrohnaJFJohn G. Frohna
- Larry D. GruppenLGLarry D. Gruppen
- James O. WoolliscroftJWJames O. Woolliscroft
- 1 June 2004
- journal article
- research article
- Published by Oxford University Press (OUP) in Academic Medicine
- Vol. 79 (6) , 564-570
Abstract
Entering residents have variable medical school experiences and differing knowledge and skill levels. To structure curricula, enhance patient safety, and begin to meet accreditation requirements, baseline assessment of individual resident's knowledge and skills is needed. To this end, in 2001 the University of Michigan Health System created the Postgraduate Orientation Assessment (POA), an eight-station, objective structured clinical examination for incoming residents. The POA, administered at orientation, included items addressing critical laboratory values, cross-cultural communication, evidence-based medicine, radiographic image interpretation, informed consent, pain assessment and management, aseptic technique, and system compliance such as fire safety. The POA assessed many of the skills needed by interns in their initial months of training when supervision by senior physicians might not be present. In 2002, 132 interns from 14 different specialties and 59 different schools participated in the POA. The mean score was 74.8% (SD = 5.8). When scores were controlled for U.S. Medical Licensing Examination scores, there were no significant differences in performance across specialties. There were differences between University of Michigan Medical School graduates and those from other institutions (p < .001). Eighty-one percent of the residents would recommend the POA. The POA provides a feasible format to measure initial knowledge and skills and identify learning needs. Orientation is an effective time to identify important gaps in learning between medical school and residency. This is the first step in a continuing evaluation of the Accreditation Council for Graduate Medical Education's general competencies.Keywords
This publication has 12 references indexed in Scilit:
- What are the clinical skills levels of newly graduated physicians? Self‐assessment study of an intended curriculum identified by a Delphi processMedical Education, 2002
- Defining and Assessing Professional CompetenceJAMA, 2002
- Competence Is a HabitJAMA, 2002
- The Effects of Examiner Background, Station Organization, and Time of Exam on OSCE Scores Assessing Undergraduate Medical Studentsʼ Physical Examination SkillsAcademic Medicine, 2000
- Educational Programs in US Medical Schools, 1999-2000JAMA, 2000
- Can medical schools rely on clerkships to train students in basic clinical skills?Medical Education, 1999
- Learning Objectives for Medical Student Education— Guidelines for Medical Schools: Report I of the Medical School Objectives ProjectJournal of the Association of American Medical Colleges, 1999
- Value of case-of-the-week presentations on the radiology component of the comprehensive clinical assessment examinationAcademic Radiology, 1998
- Consensus methods: characteristics and guidelines for use.American Journal of Public Health, 1984
- The Development of Performance Standards for Medical StudentsEvaluation & the Health Professions, 1980