User Experience Evaluation of a Spinal Surgery Robot: Workload, Usability, and Satisfaction Study
Open Access
- 1 April 2024
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 11, e54425
Abstract
Background: Robotic spine surgery has continued to evolve since its US Food and Drug Administration approval in 2004, with products now including real-time video guidance and navigation during surgery. As the market for robotic surgical devices evolves, it is important to consider usability factors. Objective: The primary objective of this study was to determine the user experience of a surgical-assistive robotic device. The secondary objective was to evaluate workload, usability, the After-Scenario Questionnaire (ASQ), and the System Usability Scale (SUS). In addition, this study compares the workload, usability, and satisfaction survey of the device among different occupational groups using the device. Methods: Doctors (n=15) and nurses (n=15), the intended users of the surgical assistant robot, participated in the usability evaluation. Participants performed essential scenarios for the surgical assistant robot and provided scenario-specific satisfaction (ASQ), workload (NASA Task Load Index), and usability (SUS) scores. Results: Both doctors and nurses had task success rates of 85% or higher for each scenario. ASQ results showed that both doctors and nurses were least satisfied with ease of completing the task of registration (group 1: mean 4.73, SD 1.57 and group 2: mean 4.47, SD 1.8), amount of time it took (group 1: mean 4.47, SD 1.63 and group 2: mean 4.40, SD 2.09), and support information satisfaction (group 1: mean 5.13, SD 1.50 and group 2: mean 5.13, SD 1.89). All participants had low workloads, and the overall Task Load Index score had a P value of .77, which is greater than .05. The SUS results showed that the overall usability mean for doctors was 64.17 (SD 16.52) and the mean for nurses was 61.67 (SD 19.18), with a P value of .84, which is greater than .05, indicating no difference between the 2 groups. Conclusions: In this study, doctors and nurses evaluated the interaction of the device in a simulated environment, the operating room. By evaluating the use experience and usability of the device with real intended users, we can develop a more effective and convenient user interface.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Robotic Spine Surgery: Past, Present, and FutureSpine, 2022
- Robotic navigation in spine surgery: Where are we now and where are we going?Journal of Clinical Neuroscience, 2021
- Technologic Evolution of Navigation and Robotics in Spine Surgery: A Historical PerspectiveWorld Neurosurgery, 2021
- Design and control of an image‐guided robot for spine surgery in a hybrid ORThe International Journal of Medical Robotics and Computer Assisted Surgery, 2020
- The System Usability Scale: Past, Present, and FutureInternational Journal of Human–Computer Interaction, 2018
- Mental workload measurement in operator control room using NASA-TLXIOP Conference Series: Materials Science and Engineering, 2017
- Higher Mental Workload is Associated With Poorer Laparoscopic Performance as Measured by the NASA-TLX ToolSimulation in Healthcare: The Journal of the Society for Simulation in Healthcare, 2010
- AN AFTER-SCENARIO QUESTIONNAIRE FOR USABILITY STUDIESACM SIGCHI Bulletin, 1991
- Psychometric evaluation of an after-scenario questionnaire for computer usability studiesACM SIGCHI Bulletin, 1991
- Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research1988