Assessing and Documenting the Cognitive Performance of Family Medicine Residents Practicing Outpatient Medicine
Authors:
- Allen F. ShaughnessyASAllen F. Shaughnessy
- Katherine T. ChangKCKatherine T. Chang
- Jennifer SparksJSJennifer Sparks
- Molly Cohen-OsherMCMolly Cohen-Osher
- Joseph GravelJGJoseph Gravel
- 1 September 2014
- journal article
- Published by Journal of Graduate Medical Education in Journal of Graduate Medical Education
- Vol. 6 (3) , 526-531
Abstract
Background: Development of cognitive skills for competent medical practice is a goal of residency education. Cognitive skills must be developed for many different clinical situations. Innovation: We developed the Resident Cognitive Skills Documentation (CogDoc) as a method for capturing faculty members' real-time assessment of residents' cognitive performance while they precepted them in a family medicine office. The tool captures 3 dimensions of cognitive skills: medical knowledge, understanding, and its application. This article describes CogDoc development, our experience with its use, and its reliability and feasibility. Methods: After development and pilot-testing, we introduced the CogDoc at a single training site, collecting all completed forms for 14 months to determine completion rate, competence development over time, consistency among preceptors, and resident use of the data. Results: Thirty-eight faculty members completed 5021 CogDoc forms, documenting 29% of all patient visits by 33 residents. Competency was documented in all entrustable professional activities. Competence was statistically different among residents of different years of training for all 3 dimensions and progressively increased within all residency classes over time. Reliability scores were high: 0.9204 for the medical knowledge domain, 0.9405 for understanding, and 0.9414 for application. Almost every resident reported accessing the individual forms or summaries documenting their performance. Conclusions: The CogDoc approach allows for ongoing assessment and documentation of resident competence, and, when compiled over time, depicts a comprehensive assessment of residents' cognitive development and ability to make decisions in ambulatory medicine. This approach meets criteria for an acceptable tool for assessing cognitive skills.Keywords
This publication has 16 references indexed in Scilit:
- Preparing medical students for clinical decision making: A pilot study exploring how students make decisions and the perceived impact of a clinical decision making teaching interventionMedical Teacher, 2012
- The Next GME Accreditation System — Rationale and BenefitsNew England Journal of Medicine, 2012
- Assessing individual clinical performance: a primer for physiciansInternal Medicine Journal, 2011
- A plea for new psychometric models in educational assessmentMedical Education, 2006
- Entrustability of professional activities and competency‐based trainingMedical Education, 2005
- Assuring the reliability of resident performance appraisals: More items or more observations?Surgery, 2005
- Exploring the Etiology of Content SpecificityAcademic Medicine, 1998
- How can we test clinical reasoning?The Lancet, 1995
- Dimensionality, internal consistency and interrater reliability of clinical performance ratingsMedical Education, 1987
- Assessing Clinical Skills of Residents with Standardized PatientsAnnals of Internal Medicine, 1986