In Situ Visualization for 3D Ultrasound-Guided Interventions with Augmented Reality Headset
Open Access
- 25 September 2021
- journal article
- research article
- Published by MDPI AG in Bioengineering
- Vol. 8 (10) , 131
Abstract
Augmented Reality (AR) headsets have become the most ergonomic and efficient visualization devices to support complex manual tasks performed under direct vision. Their ability to provide hands-free interaction with the augmented scene makes them perfect for manual procedures such as surgery. This study demonstrates the reliability of an AR head-mounted display (HMD), conceived for surgical guidance, in navigating in-depth high-precision manual tasks guided by a 3D ultrasound imaging system. The integration between the AR visualization system and the ultrasound imaging system provides the surgeon with real-time intra-operative information on unexposed soft tissues that are spatially registered with the surrounding anatomic structures. The efficacy of the AR guiding system was quantitatively assessed with an in vitro study simulating a biopsy intervention aimed at determining the level of accuracy achievable. In the experiments, 10 subjects were asked to perform the biopsy on four spherical lesions of decreasing sizes (10, 7, 5, and 3 mm). The experimental results showed that 80% of the subjects were able to successfully perform the biopsy on the 5 mm lesion, with a 2.5 mm system accuracy. The results confirmed that the proposed integrated system can be used for navigation during in-depth high-precision manual tasks.Keywords
Funding Information
- Ministero dell’Istruzione, dell’Università e della Ricerca (CrossLab)
- Regione Toscana (CRIO2AR)
This publication has 40 references indexed in Scilit:
- Role of Ultrasonic Shear Rate Estimation Errors in Assessing Inflammatory Response and Vascular RiskUltrasound in Medicine & Biology, 2008
- Review of tissue simulating phantoms for optical spectroscopy, imaging and dosimetryJournal of Biomedical Optics, 2006
- Optical and acoustic properties at 1064 nm of polyvinyl chloride-plastisol for use as a tissue phantom in biomedical optoacousticsPhysics in Medicine & Biology, 2005
- A review of calibration techniques for freehand 3-D ultrasound systemsUltrasound in Medicine & Biology, 2005
- Augmented reality guidance for needle biopsies: An initial randomized, controlled trial in phantoms††A preliminary version of this paper was presented at the Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2001 conference in Utrecht. The Netherlands (Rosenthal et al., 2001)Medical Image Analysis, 2002
- Recent advances in augmented realityIEEE Computer Graphics and Applications, 2001
- Three-dimensional freehand ultrasound: Image reconstruction and volume analysisUltrasound in Medicine & Biology, 1997
- Towards performing ultrasound-guided needle biopsies from within a head-mounted display1996
- 3d ultrasonic image feature localization based on magnetic scanhead tracking: In vitro calibration and validationUltrasound in Medicine & Biology, 1994
- Robot sensor calibration: solving AX=XB on the Euclidean groupIEEE Transactions on Robotics and Automation, 1994