A Surgical Scene Replay System for Learning Gastroenterological Endoscopic Surgery Skill by Multiple Synchronized-Video and Gaze Representation
Open Access
- 27 May 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 5 (EICS) , 1-22
Abstract
Gastroenterological endoscopic surgery needs complex surgical skills such as a sensation of body movement and manipulation of the endoscope that is hard to be explained verbally. Prior research reported that endoscopic surgery is one of the most challenging surgery to teach. Thus, surgeons need long-term practice to master the skills. To support learning such skills, we developed a surgical scene replay system. First, we surveyed 12 surgeons to reveal the reason for the difficulty and elicited three requirements for our system: (1) provide multiple videos that include an endoscope, a fluoroscopy, and hand manipulation for the endoscope to observe the surgery from multiple aspects; (2) visualize an experts' gaze position to understand experts' intention of hand manipulation, and (3) enlarge the size of the gazed video to inform learners where they should pay attention to. Our user study with the system indicates that participants could understand the experts' intentions and tacit knowledge easier than the existing video materials.Keywords
This publication has 41 references indexed in Scilit:
- Analysis of eye gaze: Do novice surgeons look at the same location as expert surgeons during a laparoscopic operation?Surgical Endoscopy, 2012
- Receiving video-based feedback in elite ice-hockey: a player's perspectiveSport, Education and Society, 2011
- Effectiveness of Laparoscopic Computer Simulator Versus Usage of Box Trainer for Endoscopic Surgery Training of NovicesJournal of Surgical Education, 2011
- Drilling SurgeonsScience, Technology, & Human Values, 2007
- A Prospective Randomized Study to Test the Transfer of Basic Psychomotor Skills From Virtual Reality to Physical Reality in a Comparable Training SettingAnnals of Surgery, 2005
- Virtual reality surgical laparoscopic simulatorsSurgical Endoscopy, 2003
- Are Surgery Training Programs Ready for Virtual Reality? A Survey of Program Directors in General SurgeryJournal of the American College of Surgeons, 2001
- Endoscopic surgery training using virtual reality and deformable tissue simulationComputers & Graphics, 2000
- Computer-assisted Learning versus a Lecture and Feedback Seminar for Teaching a Basic Surgical Technical SkillThe American Journal of Surgery, 1998
- Why do users like video?Computer Supported Cooperative Work (CSCW), 1992