A Document Analysis of Nationally Available Faculty Assessment Forms of Resident Performance
Open Access
- 1 December 2021
- journal article
- research article
- Published by Journal of Graduate Medical Education in Journal of Graduate Medical Education
- Vol. 13 (6) , 833-840
Abstract
Background: Written feedback by faculty of resident performance is valuable when it includes components based on assessment for learning. However, it is not clear how often assessment forms include these components for summative and formative feedback. Objective: To analyze prompts used in forms for faculty assessment of resident performance, guided by best practices in survey research methodology, self-regulation theory, and competency-based assessment. Methods: A document analysis, which is a qualitative approach used to analyze content and structure of texts, was completed on assessment forms nationally available in MedHub. Due to the number of forms available, only internal medicine and surgery specialties were included. A document summary form was created to analyze the assessments. The summary form guided researchers through the analysis. Results: Forty-eight forms were reviewed, each from a unique residency program. All forms provided a textbox for comments, and 54% made this textbox required for assessment completion. Eighty-three percent of assessments placed the open textbox at the end of the form. One-third of forms contained a simple prompt, “Comments,” for the narrative section. Fifteen percent of forms included a box to check if the information on the form had been discussed with the resident. Fifty percent of the assessments were unclear if they were meant to be formative or summative in nature. Conclusions: Our document analysis of assessment forms revealed they do not always follow best practices in survey design for narrative sections, nor do they universally address elements deemed important for promotion of self-regulation and competency-based assessment.Keywords
This publication has 25 references indexed in Scilit:
- Developing questionnaires for educational research: AMEE Guide No. 87Medical Teacher, 2014
- What Do Our Respondents Think We're Asking? Using Cognitive Interviewing to Improve Medical Education SurveysJournal of Graduate Medical Education, 2013
- Self-regulation theory: Applications to medical education: AMEE Guide No. 58Medical Teacher, 2011
- Competencies “Plus”: The Nature of Written Comments on Internal Medicine Residentsʼ Evaluation FormsAcademic Medicine, 2011
- Residency Programs' Evaluations of the Competencies: Data Provided to the ACGME About Types of Assessments Used by ProgramsJournal of Graduate Medical Education, 2010
- The Open-Ended Comment Space for Action Plans on Core Clerkship Studentsʼ Encounter Cards: What Gets Written?Academic Medicine, 2010
- Document Analysis as a Qualitative Research MethodQualitative Research Journal, 2009
- Design and Evaluation of Survey Questions2009
- Assessing the quality of supervisors’ completed clinical evaluation reportsMedical Education, 2008
- Self-reports: How the questions shape the answers.American Psychologist, 1999