Head-Mounted Displays in Context-Aware Systems for Open Surgery: A State-of-the-Art Review
Open Access
- 28 October 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 29 (2) , 1165-1175
Abstract
Surgical context-aware systems (SCAS), which leverage real-time data and analysis from the operating room to inform surgical activities, can be enhanced through the integration of head-mounted displays (HMDs). Rather than user-agnostic data derived from conventional, and often static, external sensors, HMD-based SCAS relies on dynamic user-centric sensing of the surgical context. The analyzed context-aware information is then augmented directly into a user's field of view via augmented reality (AR) to directly improve their task and decision-making capability. This stateof-the-art review complements previous reviews by exploring the advancement of HMD-based SCAS, including their development and impact on enhancing situational awareness and surgical outcomes in the operating room. The survey demonstrates that this technology can mitigate risks associated with gaps in surgical expertise, increase procedural efficiency, and improve patient outcomes. We also highlight key limitations still to be addressed by the research community, including improving prediction accuracy, robustly handling data heterogeneity, and reducing system latency.Keywords
This publication has 62 references indexed in Scilit:
- SurgeonAssist-Net: Towards Context-Aware Head-Mounted Display-Based Augmented Reality for Surgical Guidance2021
- Multi-view Surgical Video Action Detection via Mixed Global View Attention2021
- Automatic Operating Room Surgical Activity Recognition for Robot-Assisted Surgery2020
- 11‐1: Invited Paper : Towards the Ultimate Mixed Reality Experience: HoloLens Display Architecture ChoicesSID Symposium Digest of Technical Papers, 2017
- Temporal Segment Networks: Towards Good Practices for Deep Action Recognition2016
- Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomyLangenbeck's Archives of Surgery, 2014
- Robotic duodenopancreatectomy assisted with augmented reality and real-time fluorescence guidanceSurgical Endoscopy, 2014
- Context-Based Workplace AwarenessComputer Supported Cooperative Work (CSCW), 2010
- Knowledge-Based Situation Interpretation for Context-Aware Augmented Reality in Dental Implant Surgery2010
- Image overlay navigation by markerless surface registration in gastrointestinal, hepatobiliary and pancreatic surgeryJournal of Hepato-Biliary-Pancreatic Sciences, 2009