Towards Better Debriefing Through Context-Aware Video Segmentation in Standardized Patient Encounter Ear Exams
Authors:
- 5 February 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 162-165
Abstract
Evaluating medical students' physical skills is vital for assessing and validating the acquisition and utilization of their medical knowledge. However, the conventional method of human-based grading for standardized patient encounter videos is costly and error-prone, requires the participation of experts, and may suffer from inter-rater reliability issues and long processing times. Here we propose a deep learning pipeline to identify, extract and score ear exams in over a thousand Simulation Center COSCE medical encounter videos. Our three-stage approach consists of audio-based pre-segmentation with Whisper and Silero VAD, tool detection with CLIP and body node detection with Detectron2. The results of our pipeline are then compared to human graded output and used for automatic extraction of the most relevant video segments. This approach represents a first step toward our overarching goal of expediting and enhancing the quality of the debriefing process following standardized assessments.Keywords
This publication has 22 references indexed in Scilit:
- Developing artificial intelligence models for medical student suturing and knot-tying video-based assessment and coachingSurgical Endoscopy, 2022
- Measuring the Effect of Examiner Variability in a Multiple-Circuit Objective Structured Clinical Examination (OSCE)Academic Medicine, 2021
- Deep learning-enabled medical computer visionnpj Digital Medicine, 2021
- Approaches to Teaching the Physical Exam to Preclerkship Medical Students: Results of a National SurveyAcademic Medicine, 2019
- Resources Used to Teach the Physical Exam to Preclerkship Medical Students: Results of a National SurveyAcademic Medicine, 2018
- Data-driven spatio-temporal RGBD feature encoding for action recognition in operating roomsInternational Journal of Computer Assisted Radiology and Surgery, 2015
- Assessment of Clinical Skills With Standardized Patients: State of the Art RevisitedTeaching and Learning in Medicine, 2013
- Exploring the use of videotaped objective structured clinical examination in the assessment of joint examination skills of medical studentsArthritis Care & Research, 2007
- Video otoscopy: Bringing otoscopy out of the “black box”International Journal of Pediatric Otorhinolaryngology, 2006
- A comparative analysis of the costs of administration of an OSCE (objective structured clinical examination)Academic Medicine, 1994