Video-based interventions to improve self-assessment accuracy among physicians: A systematic review
Open Access
- 13 July 2023
- journal article
- review article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 18 (7) , e0288474
Abstract
Purpose: Self-assessment of a physician’s performance in both procedure and non-procedural activities can be used to identify their deficiencies to allow for appropriate corrective measures. Physicians are inaccurate in their self-assessments, which may compromise opportunities for self- development. To improve this accuracy, video-based interventions of physicians watching their own performance, an experts’ performance or both, have been proposed to inform their self-assessment. We conducted a systematic review of the effectiveness of video-based interventions targeting improved self-assessment accuracy among physicians. Materials and methods: The authors performed a systematic search of MEDLINE, Embase, EBM reviews, and Scopus databases from inception to August 23, 2022, using combinations of terms for “self-assessment”, “video-recording”, and “physician”. Eligible studies were empirical investigations assessing the effect of video-based interventions on physicians’ self-assessment accuracy with a comparison of self-assessment accuracy pre- and post- video intervention. We defined self-assessment accuracy as a “direct comparison between an external evaluator and self-assessment that was quantified using formal statistical analysis”. Two reviewers independently screened records, extracted data, assessed risk of bias, and evaluated quality of evidence. A narrative synthesis was conducted, as variable outcomes precluded a meta-analysis. Results: A total of 2,376 papers were initially retrieved. Of these, 22 papers were selected for full-text review; a final 9 studies met inclusion criteria for data extraction. Across studies, 240 participants from 5 specialties were represented. Video-based interventions included self-video review (8/9), benchmark video review (3/9), and/or a combination of both types (1/9). Five out of nine studies reported that participants had inaccurate self-assessment at baseline. After the intervention, 5 of 9 studies found a statistically significant improvement in self-assessment accuracy. Conclusions: Overall, current data suggests video-based interventions can improve self-assessment accuracy. Benchmark video review may enable physicians to improve self-assessment accuracy, especially for those with limited experience performing a particular clinical skill. In contrast, self-video review may be able to provide improvement in self-assessment accuracy for more experience physicians. Future research should use standardized methods of comparison for self-assessment accuracy, such as the Bland-Altman analysis, to facilitate meta-analytic summation.Keywords
Funding Information
- Ontario Ministry of Research and Innovation
This publication has 34 references indexed in Scilit:
- Statistical Methods Used to Test for Agreement of Medical Instruments Measuring Continuous Variables in Method Comparison Studies: A Systematic ReviewPLOS ONE, 2012
- Improving the accuracy of self-assessment of practical clinical skills using video feedback – The importance of including benchmarksMedical Teacher, 2012
- Simulation-based Emergency Medicine Resident Self-AssessmentThe Journal of Emergency Medicine, 2011
- QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy StudiesAnnals of Internal Medicine, 2011
- Medical students’ self-assessment of performance: Results from three meta-analysesPatient Education and Counseling, 2011
- The Processes and Dimensions of Informed Self-Assessment: A Conceptual ModelAcademic Medicine, 2010
- The effectiveness of self-assessment on the identification of learner needs, learner activity, and impact on clinical practice: BEME Guide no. 10Medical Teacher, 2008
- Observational Modeling Effects for Movement Dynamics and Movement Outcome Measures Across Differing Task Constraints: A Meta-AnalysisJournal of Motor Behavior, 2006
- A global assessment tool for evaluation of intraoperative laparoscopic skillsThe American Journal of Surgery, 2005
- The value of videotape in mock oral board examinationsCurrent Surgery, 2004