BHBrian A. Hargreaves

Brian A. Hargreaves

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Brian A. Hargreaves has a total of 84 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Multimodal Feedback for Handheld Tool Guidance: Combining Wrist-Based Haptics with Augmented Reality

    by Yue Yang, Christoph Leuze, Brian Hargreaves, Bruce Daniel, Fred M Baik

    We investigate how vibrotactile wrist feedback can enhance spatial guidance for handheld tool movement in optical see-through augmented reality (AR). While AR overlays are widely used to support surgical tasks, visual occlusion, lighting conditions, and interface ambiguity can compromise precision and confidence. To address these challenges, we designed a multimodal system combining AR visuals with a custom wrist-worn haptic device delivering directional and state-based cues. A formative study with experienced surgeons and residents identified key tool maneuvers and preferences for reference mappings, guiding our cue design. In a cue identification experiment (N=21), participants accurately recognized five vibration patterns under visual load, with higher recognition for full-actuator states than spatial direction cues. In a guidance task (N=27), participants using both AR and haptics achieved significantly higher spatial precision (5.8 mm) and usability (SUS = 88.1) than those using either modality alone, despite having modest increases in task time. Participants reported that haptic cues provided reassuring confirmation and reduced cognitive effort during alignment. Our results highlight the promise of integrating wrist-based haptics into AR systems for high-precision, visually complex tasks such as surgical guidance. We discuss design implications for multimodal interfaces supporting confident, efficient tool manipulation.

  • Open Access

    Relative SNR Measurements in Supine vs. Prone Breast MRI

    by Jeremiah J. Hess, Catherine J. Moran, Preya Shah, Jana Vincent, Fraser J. L. Robb, Bruce L. Daniel, Brian A. Hargreaves

    Purpose: Supine breast MRI has the potential to improve patient comfort compared to prone breast MRI, in addition to providing images in the same position as subsequent treatment protocols. Novel flexible coil arrays have enabled high SNR and parallel imaging in supine breast imaging, but the combined effect of coil and patient positioning on SNR has yet to be investigated. The aim of this study is to use a tissue‐independent metric to account for tissue deformation to compare SNR between prone and supine positions, using appropriate coils for each. Methods: Relative SNR (rSNR) metric is proposed as the ratio of SNR between a breast coil and a body coil. This metric is demonstrated to be tissue‐independent, allowing for easier SNR comparisons in cases of tissue deformation. We scanned 10 female subjects and compared the rSNR in segmented regions consisting of breast tissue, chest wall, and axilla between prone and supine breast imaging. Results: The rSNR was significantly higher in the breast tissue and chest wall in the supine position for all cases. The axilla rSNR was significantly higher in supine for four cases, with another four significantly higher in prone, and two showing no statistical difference. Using a distance‐from‐coil analysis, we found that the tissue is closer to the coil in supine, and that the supine coil provided higher SNR at distances closer than 4cm. Conclusion: Our results show that using a surface array coil in the supine position can provide higher SNR than a standard setup in most subjects for most relevant regions of breast MRI.


  • Open Access

    Markerless Augmented Reality Registration for Surgical Guidance: A Multi-Anatomy Clinical Accuracy Study

    by Yue Yang, Fabian Necker, Christoph Leuze, Michelle Chen, Andrey Finegersh, Jake Lee, Vasu Divi, Bruce Daniel, Brian Hargreaves, Jie Ying Wu, et al.

    Purpose: In this paper, we develop and clinically evaluate a depth-only, markerless augmented reality (AR) registration pipeline on a head-mounted display, and assess accuracy across small or low-curvature anatomies in real-life operative settings. Methods: On HoloLens 2, we align Articulated HAnd Tracking (AHAT) depth to Computed Tomography (CT)-derived skin meshes via (i) depth-bias correction, (ii) brief human-in-the-loop initialization, (iii) global and local registration. We validated the surface-tracing error metric by comparing "skin-to-bone" relative distances to CT ground truth on leg and foot models, using an AR-tracked tool. We then performed seven intraoperative target trials (feet x2, ear x3, leg x2) during the initial stage of fibula free-flap harvest and mandibular reconstruction surgery, and collected 500+ data per trial. Results: Preclinical validation showed tight agreement between AR-traced and CT distances (leg: median |Delta d| 0.78 mm, RMSE 0.97 mm; feet: 0.80 mm, 1.20 mm). Clinically, per-point error had a median of 3.9 mm. Median errors by anatomy were 3.2 mm (feet), 4.3 mm (ear), and 5.3 mm (lower leg), with 5 mm coverage 92-95%, 84-90%, and 72-86%, respectively. Feet vs. lower leg differed significantly (Delta median ~1.1 mm; p < 0.001). Conclusion: A depth-only, markerless AR pipeline on HMDs achieved ~3-4 mm median error across feet, ear, and lower leg in live surgical settings without fiducials, approaching typical clinical error thresholds for moderate-risk tasks. Human-guided initialization plus global-to-local registration enabled accurate alignment on small or low-curvature targets, improving the clinical readiness of markerless AR guidance.

  • From microscope to head-mounted display: integrating hand tracking into microsurgical augmented reality

    by Trishia El Chemaly, Caio Athayde Neves, Fanrui Fu, Brian Hargreaves, Nikolas H. Blevins

    Purpose The operating microscope plays a central role in middle and inner ear procedures that involve working within tightly confined spaces under limited exposure. Augmented reality (AR) may improve surgical guidance by combining preoperative computed tomography (CT) imaging that can provide precise anatomical information, with intraoperative microscope video feed. With current technology, the operator must manually interact with the AR interface using a computer. The latter poses a disruption in the surgical flow and is suboptimal for maintaining the sterility of the operating environment. The purpose of this study was to implement and evaluate free-hand interaction concepts leveraging hand tracking and gesture recognition as an attempt to reduce the disruption during surgery and improve human-computer interaction. Methods An electromagnetically tracked surgical microscope was calibrated using a custom 3D printed calibration board. This allowed the augmentation of the microscope feed with segmented preoperative CT-derived virtual models. Ultraleap’s Leap Motion Controller 2 was coupled to the microscope and used to implement hand-tracking capabilities. End-user feedback was gathered from a surgeon during development. Finally, users were asked to complete tasks that involved interacting with the virtual models, aligning them to physical targets, and adjusting the AR visualization. Results Following observations and user feedback, we upgraded the functionalities of the hand interaction system. User feedback showed the users’ preference for the new interaction concepts that provided minimal disruption of the surgical workflow and more intuitive interaction with the virtual content. Conclusion We integrated hand interaction concepts, typically used with head-mounted displays (HMDs), into a surgical stereo microscope system intended for AR in otologic microsurgery. The concepts presented in this study demonstrated a more favorable approach to human-computer interaction in a surgical context. They hold potential for a more efficient execution of surgical tasks under microscopic AR guidance.


  • Clinical evaluation of isotropic MAVRIC-SL for symptomatic hip arthroplasties at 3 T MRI

    by Daehyun Yoon, Zoe Doyle, Philip Lee, Brian Hargreaves, Kathryn Stevens


  • Stereoscopic calibration for augmented reality visualization in microscopic surgery

    by Trishia El Chemaly, Caio Athayde Neves, Christoph Leuze, Brian Hargreaves, Nikolas H. Blevins

    Purpose Middle and inner ear procedures target hearing loss, infections, and tumors of the temporal bone and lateral skull base. Despite the advances in surgical techniques, these procedures remain challenging due to limited haptic and visual feedback. Augmented reality (AR) may improve operative safety by allowing the 3D visualization of anatomical structures from preoperative computed tomography (CT) scans on real intraoperative microscope video feed. The purpose of this work was to develop a real-time CT-augmented stereo microscope system using camera calibration and electromagnetic (EM) tracking. Methods A 3D printed and electromagnetically tracked calibration board was used to compute the intrinsic and extrinsic parameters of the surgical stereo microscope. These parameters were used to establish a transformation between the EM tracker coordinate system and the stereo microscope image space such that any tracked 3D point can be projected onto the left and right images of the microscope video stream. This allowed the augmentation of the microscope feed of a 3D printed temporal bone with its corresponding CT-derived virtual model. Finally, the calibration board was also used for evaluating the accuracy of the calibration. Results We evaluated the accuracy of the system by calculating the registration error (RE) in 2D and 3D in a microsurgical laboratory setting. Our calibration workflow achieved a RE of 0.11 ± 0.06 mm in 2D and 0.98 ± 0.13 mm in 3D. In addition, we overlaid a 3D CT model on the microscope feed of a 3D resin printed model of a segmented temporal bone. The system exhibited small latency and good registration accuracy. Conclusion We present the calibration of an electromagnetically tracked surgical stereo microscope for augmented reality visualization. The calibration method achieved accuracy within a range suitable for otologic procedures. The AR process introduces enhanced visualization of the surgical field while allowing depth perception.


  • Open Access

    Improving Data-Efficiency and Robustness of Medical Imaging Segmentation Using Inpainting-Based Self-Supervised Learning

    by Jeffrey Dominic, Nandita Bhaskhar, Arjun D. Desai, Andrew Schmidt, Elka Rubin, Beliz Gunel, Garry E. Gold, Brian A. Hargreaves, Leon Lenchik, Robert Boutin, et al.

    We systematically evaluate the training methodology and efficacy of two inpainting-based pretext tasks of context prediction and context restoration for medical image segmentation using self-supervised learning (SSL). Multiple versions of self-supervised U-Net models were trained to segment MRI and CT datasets, each using a different combination of design choices and pretext tasks to determine the effect of these design choices on segmentation performance. The optimal design choices were used to train SSL models that were then compared with baseline supervised models for computing clinically-relevant metrics in label-limited scenarios. We observed that SSL pretraining with context restoration using 32 × 32 patches and Poission-disc sampling, transferring only the pretrained encoder weights, and fine-tuning immediately with an initial learning rate of 1 × 10−3 provided the most benefit over supervised learning for MRI and CT tissue segmentation accuracy (p < 0.001). For both datasets and most label-limited scenarios, scaling the size of unlabeled pretraining data resulted in improved segmentation performance. SSL models pretrained with this amount of data outperformed baseline supervised models in the computation of clinically-relevant metrics, especially when the performance of supervised learning was low. Our results demonstrate that SSL pretraining using inpainting-based pretext tasks can help increase the robustness of models in label-limited scenarios and reduce worst-case errors that occur with supervised learning.


  • On-the-Fly Adaptive ${k}$ -Space Sampling for Linear MRI Reconstruction Using Moment-Based Spectral Analysis

    by Evan Levine, Brian Hargreaves

    In high-dimensional magnetic resonance imaging applications, time-consuming, sequential acquisition of data samples in the spatial frequency domain (k-space) can often be accelerated by accounting for dependencies in linear reconstruction, at the cost of noise amplification that depends on the sampling pattern. Common examples are support-constrained, parallel, and dynamic MRI, and k-space sampling strategies are primarily driven by image-domain metrics that are expensive to compute for arbitrary sampling patterns. It remains challenging to provide systematic and computationally efficient automatic designs of arbitrary multidimensional Cartesian sampling patterns that mitigate noise amplification, given the subspace to which the object is confined. To address this problem, this paper introduces a theoretical framework that describes local geometric properties of the sampling pattern and relates them to the spread in the eigenvalues of the information matrix described by its first two spectral moments. This new criterion is then used for very efficient optimization of complex multidimensional sampling patterns that does not require reconstructing images or explicitly mapping noise amplification. Experiments with in vivo data show strong agreement between this criterion and traditional, comprehensive image-domain- and k-space-based metrics, indicating the potential of the approach for computationally efficient (on-the-fly), automatic, and adaptive design of sampling patterns.


  • Relative value of three whole-body MR approaches for PET-MR, including gadofosveset-enhanced MR, in comparison to PET-CT

    by Piotr Obara, Andreas Loening, Valentina Taviani, Andrei Iagaru, Brian A. Hargreaves, Shreyas Vasanawala


  • 2D multi‐spectral imaging for fast MRI near metal

    by Brian A. Hargreaves, Valentina Taviani, Daniel V. Litwiller, Daehyun Yoon

    Purpose: To develop a fast 2D method for MRI near metal with reduced B0 in‐plane and through‐slice artifacts.Methods: Multi‐spectral imaging (MSI) approaches reduce artifacts in MR images near metal, but require 3D imaging of multiple excited volumes regardless of imaging geometry or artifact severity. The proposed 2D MSI method rapidly excites a limited slice and spectral region using gradient reversal between excitation and refocusing pulses, then uses standard 2D imaging, with the process repeating to cover multiple spectral offsets that are combined as in other MSI techniques. 2D MSI was implemented in a spin‐echo‐train sequence and validated in phantoms and in vivo by comparing it with standard spin‐echo imaging and existing MSI techniques.Results: 2D MSI images for each spatial‐spectral region follow isocontours of the dipole‐like B0 field variation, and thus frequency variation, near metal devices. Artifact correction in phantoms and human subjects with metal is comparable to 3D MSI methods, and superior to standard spin‐echo techniques. Scan times are reduced compared with 3D MSI methods in cases where a limited number of slices are needed, though signal‐to‐noise ratio is also reduced as expected.Conclusion: 2D MSI offers a fast and flexible alternative to 3D MSI for artifact reduction near metal. Magn Reson Med 79:968–973, 2018. © 2017 International Society for Magnetic Resonance in Medicine.