Workshop, Assessment, and Validity Evidence for Tools Measuring Performance of Knee and Shoulder Arthrocentesis
Open Access
- 13 April 2023
- journal article
- research article
- Published by Association of American Medical Colleges in MedEdPORTAL
- Vol. 19, 11309
Abstract
Musculoskeletal concerns are common, yet residents at our institution lacked arthrocentesis training. We created a workshop to teach residents knee and shoulder arthrocentesis, developed simulated assessment scenarios (SASs) with tools to measure procedural proficiency, and collected validity evidence. A multidisciplinary group conducted a modified Delphi to define content for the workshop, SASs, and assessment tools. We defined minimum thresholds for competence in knee and shoulder arthrocentesis using the modified borderline-group method. We implemented the workshop and SASs in 2020 and 2021 and analyzed assessment tool scoring for statistical reliability and validity. Our program evaluation included SAS performance, participants’ survey responses, and change in the number of arthrocenteses performed in the internal medicine (IM) resident primary care clinic. Sixty-one residents (53 IM, eight physical medicine and rehabilitation [PM&R]) participated. Fifty-two (85%; 46 IM, six PM&R) completed the evaluation survey. We procured data from 48 knee and 65 shoulder SASs for validity evidence. All arthrocentesis SAS performances met the proficiency standard except one resident's shoulder SAS. Validity evidence revealed strong interrater reliability (α = .82 and .77 for knee and shoulder, respectively) and strong relational validity (p < .001 for both procedures). All participants rated workshop quality and usefulness as good or very good. The number of arthrocenteses performed at our institution's primary care clinic increased. We created a workshop to teach residents arthrocentesis and assessment tools with strong validity and reliability evidence. The workshop was well regarded by residents, who applied their arthrocentesis skills during patient care.Keywords
This publication has 23 references indexed in Scilit:
- Musculoskeletal InjectionMayo Clinic Proceedings, 2009
- Design, Implementation, and Outcome of a Hands-on Arthrocentesis WorkshopJCR: Journal of Clinical Rheumatology, 2009
- An Intervention to Improve Procedure Education for Internal Medicine ResidentsJournal of General Internal Medicine, 2008
- A universal global rating scale for the evaluation of technical skills in the operating roomThe American Journal of Surgery, 2007
- Standard Setting in a Small Scale OSCE: A Comparison of the Modified Borderline-Group Method and the Borderline Regression MethodAdvances in Health Sciences Education, 2006
- Musculoskeletal exam and joint injection training for internal medicine residentsJournal of General Internal Medicine, 2006
- Reliability in Content Analysis.Human Communication Research, 2004
- A primary care musculoskeletal clinic for residentsJournal of General Internal Medicine, 2004
- Ensuring that the competent are truly competent: an overview of common methods and procedures used to set standards on high-stakes examinationsJournal of Veterinary Medical Education, 2004
- An instructional program to facilitate teaching joint/soft-tissue injection and aspirationJournal of General Internal Medicine, 2002