The RISE Assessment: A Tool to Evaluate Competencies in Patient Safety and Quality Improvement
- 1 April 2025
- journal article
- Published by Journal of Graduate Medical Education in Journal of Graduate Medical Education
- Vol. 17 (2) , 217-223
Abstract
Background Medical schools and residency programs have increasingly established formal education and standardized curricula in patient safety and quality improvement. However, assessment of resident and fellow proficiency in these areas can be challenging. Our institution needed a tool with a broad scope of content and detailed competency levels. We therefore created the Rochester Improvement and Safety Education (RISE) Assessment. Objective To describe the development, structure, and implementation of the RISE Assessment and provide preliminary validity evidence, including feasibility of use. Methods The first axis of the tool consists of 4 domains divided into 8 subdomains and 52 content areas. The second axis utilizes a rubric, establishing consistent expectations for each proficiency level in an Accreditation Council for Graduate Medical Education Milestone-based format. A total of 1498 incoming and postgraduate year (PGY) 1-9 residents and fellows completed the RISE Assessment at least once between May 29, 2018, and August 30, 2022. This included incoming residents (N=418), PGY-1-4s (N=667), incoming fellows (N=120), and PGY-5-9s (N=293). Results Higher RISE scores were found for PGY-1-4s than incoming residents and for PGY-5-9s than incoming fellows. There was no difference in mean RISE scores between incoming fellows and PGY-1-4s. Analysis of a cohort of incoming residents (N=136) who completed the RISE Assessment upon starting their residency and then again at least 2 years later showed an increase in scores. Conclusions Higher proficiency scores with increasing PGY levels and with assessments performed by the same residents over time provide validity evidence for the RISE Assessment.Keywords
This publication has 12 references indexed in Scilit:
- Can Teamwork Promote Safety in Organizations?Annual Review of Organizational Psychology and Organizational Behavior, 2020
- Effectiveness of a quality improvement curriculum for medical studentsMedical Education Online, 2015
- The Quality Improvement Knowledge Application Tool Revised (QIKAT-R)Academic Medicine, 2014
- Assessing the patient safety competencies of healthcare professionals: a systematic reviewBMJ Quality & Safety, 2011
- Development and Preliminary Evaluation of a Practice-Based Learning and Improvement Tool for Assessing Resident Competence and Guiding Curriculum DevelopmentJournal of Graduate Medical Education, 2011
- The WHO patient safety curriculum guide for medical schoolsBMJ Quality & Safety, 2010
- Teaching Quality Improvement and Patient Safety to Trainees: A Systematic ReviewAcademic Medicine, 2010
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- Imaging Studies for Low Back PainJournal of Pain & Palliative Care Pharmacotherapy, 2008
- Teaching and assessing resident competence in practice-based learning and improvementJournal of General Internal Medicine, 2004