Balázs Faludi
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Balázs Faludi has a total of 26 co-authors. Here are the top co-authors by number of shared publications:
Georg Rauter
Department of Biomedical Engineering, University of Basel, Basel, Switzerland
3 shared publicationsPhilippe C. Cattin
Department of Biomedical Engineering, University of Basel, Basel, Switzerland
3 shared publicationsGregory F. Jost
Spinale Chirurgie, Hospital Biel, Biel, Switzerland
2 shared publications- Marek Zelechowski
Center for medical Image Analysis & Navigation, Department of Biomedical Engineering, University of Basel
2 shared publications Nicolas Gerig
BIROMED-Lab, Department of Biomedical Engineering, University of Basel, Basel, Switzerland
2 shared publications- Philippe Claude Cattin
University of Basel
2 shared publications
Latest Publications
- Open Access
- 7 June 2025
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 20 (11) , 2251-2258
Multi-volume rendering using depth buffers for surgical planning in virtual reality
Purpose: Planning highly complex surgeries in virtual reality (VR) provides a user-friendly and natural way to navigate volumetric medical data and can improve the sense of depth and scale. Using ray marching-based volume rendering to display the data has several benefits over traditional mesh-based rendering, such as offering a more accurate and detailed visualization without the need for prior segmentation and meshing. However, volume rendering can be difficult to extend to support multiple intersecting volumes in a scene while maintaining a high enough update rate for a comfortable user experience in VR. Methods: Upon loading a volume, a rough ad hoc segmentation is performed using a motion-tracked controller. The segmentation is not used to extract a surface mesh and does not need to precisely define the exact surfaces to be rendered, as it only serves to separate the volume into individual sub-volumes, which are rendered in multiple, consecutive volume rendering passes. For each pass, the ray lengths are written into the camera depth buffer at early ray termination and read in subsequent passes to ensure correct occlusion between individual volumes. Results: We evaluate the performance of the multi-volume renderer using three different use cases and corresponding datasets. We show that the presented approach can avoid dropped frames at the typical update rate of 90 frames per second of a desktop-based VR system and, therefore, provide a comfortable user experience even in the presence of more than twenty individual volumes. Conclusion: Our proof-of-concept implementation shows the feasibility of VR-based surgical planning systems, which require dynamic and direct manipulation of the original volumetric data without sacrificing rendering performance and user experience.
- 7 June 2025
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 20 (11) , 2251-2258
Open AccessMulti-volume rendering using depth buffers for surgical planning in virtual reality
Purpose: Planning highly complex surgeries in virtual reality (VR) provides a user-friendly and natural way to navigate volumetric medical data and can improve the sense of depth and scale. Using ray marching-based volume rendering to display the data has several benefits over traditional mesh-based rendering, such as offering a more accurate and detailed visualization without the need for prior segmentation and meshing. However, volume rendering can be difficult to extend to support multiple intersecting volumes in a scene while maintaining a high enough update rate for a comfortable user experience in VR. Methods: Upon loading a volume, a rough ad hoc segmentation is performed using a motion-tracked controller. The segmentation is not used to extract a surface mesh and does not need to precisely define the exact surfaces to be rendered, as it only serves to separate the volume into individual sub-volumes, which are rendered in multiple, consecutive volume rendering passes. For each pass, the ray lengths are written into the camera depth buffer at early ray termination and read in subsequent passes to ensure correct occlusion between individual volumes. Results: We evaluate the performance of the multi-volume renderer using three different use cases and corresponding datasets. We show that the presented approach can avoid dropped frames at the typical update rate of 90 frames per second of a desktop-based VR system and, therefore, provide a comfortable user experience even in the presence of more than twenty individual volumes. Conclusion: Our proof-of-concept implementation shows the feasibility of VR-based surgical planning systems, which require dynamic and direct manipulation of the original volumetric data without sacrificing rendering performance and user experience.
- Open Access
- 26 September 2024
- Published by MDPI AG in Brain Sciences
- Vol. 14 (10) , 968
Assessment of Interrater Reliability and Accuracy of Cerebral Aneurysm Morphometry Using 3D Virtual Reality, 2D Digital Subtraction Angiography, and 3D Reconstruction: A Randomized Comparative Study
Background/Objectives: Detailed morphometric analysis of an aneurysm and the related vascular bifurcation are critical factors when determining rupture risk and planning treatment for unruptured intracranial aneurysms (UIAs). The standard visualization of digital subtraction angiography (DSA) and its 3D reconstruction on a 2D monitor provide precise measurements but are subject to variability based on the rater. Visualization using virtual (VR) and augmented reality platforms can overcome those limitations. It is, however, unclear whether accurate measurements of the aneurysm and adjacent arterial branches can be obtained on VR models. This study aimed to assess interrater reliability and compare measurements between 3D VR, standard 2D DSA, and 3D DSA reconstructions, evaluating the reliability and accuracy of 3D VR as a measurement tool. Methods: A pool of five neurosurgeons performed three individual analyses on each of the ten UIA cases, measuring them in completely immersed 3D VR and the standard on-screen format (2D DSA and 3D reconstruction). This resulted in three independent measurements per modality for each case. Interrater reliability of measurements and morphology characterization, comparative differences, measurement duration, and VR user experience were assessed. Results: Interrater reliability for 3D VR measurements was significantly higher than for 3D DSA measurements (3D VR mean intraclass correlation coefficient [ICC]: 0.69 ± 0.22 vs. 3D DSA mean ICC: 0.36 ± 0.37, p = 0.042). No significant difference was observed between 3D VR and 2D DSA (3D VR mean ICC: 0.69 ± 0.22 vs. 2D DSA mean ICC: 0.43 ± 0.31, p = 0.12). A linear mixed-effects model showed no effect of 3D VR and 3D DSA (95% CI = −0.26–0.28, p = 0.96) or 3D VR and 2D DSA (95% CI = −0.02–0.53, p = 0.066) on absolute measurements of the aneurysm in the anteroposterior, mediolateral, and craniocaudal dimensions. Conclusions: 3D VR technology allows for reproducible, accurate, and reliable measurements comparable to measurements performed on a 2D screen. It may also potentially improve precision for measurements of non-planar aneurysm dimensions.
- 26 September 2024
- Published by MDPI AG in Brain Sciences
- Vol. 14 (10) , 968
Open AccessAssessment of Interrater Reliability and Accuracy of Cerebral Aneurysm Morphometry Using 3D Virtual Reality, 2D Digital Subtraction Angiography, and 3D Reconstruction: A Randomized Comparative Study
Background/Objectives: Detailed morphometric analysis of an aneurysm and the related vascular bifurcation are critical factors when determining rupture risk and planning treatment for unruptured intracranial aneurysms (UIAs). The standard visualization of digital subtraction angiography (DSA) and its 3D reconstruction on a 2D monitor provide precise measurements but are subject to variability based on the rater. Visualization using virtual (VR) and augmented reality platforms can overcome those limitations. It is, however, unclear whether accurate measurements of the aneurysm and adjacent arterial branches can be obtained on VR models. This study aimed to assess interrater reliability and compare measurements between 3D VR, standard 2D DSA, and 3D DSA reconstructions, evaluating the reliability and accuracy of 3D VR as a measurement tool. Methods: A pool of five neurosurgeons performed three individual analyses on each of the ten UIA cases, measuring them in completely immersed 3D VR and the standard on-screen format (2D DSA and 3D reconstruction). This resulted in three independent measurements per modality for each case. Interrater reliability of measurements and morphology characterization, comparative differences, measurement duration, and VR user experience were assessed. Results: Interrater reliability for 3D VR measurements was significantly higher than for 3D DSA measurements (3D VR mean intraclass correlation coefficient [ICC]: 0.69 ± 0.22 vs. 3D DSA mean ICC: 0.36 ± 0.37, p = 0.042). No significant difference was observed between 3D VR and 2D DSA (3D VR mean ICC: 0.69 ± 0.22 vs. 2D DSA mean ICC: 0.43 ± 0.31, p = 0.12). A linear mixed-effects model showed no effect of 3D VR and 3D DSA (95% CI = −0.26–0.28, p = 0.96) or 3D VR and 2D DSA (95% CI = −0.02–0.53, p = 0.066) on absolute measurements of the aneurysm in the anteroposterior, mediolateral, and craniocaudal dimensions. Conclusions: 3D VR technology allows for reproducible, accurate, and reliable measurements comparable to measurements performed on a 2D screen. It may also potentially improve precision for measurements of non-planar aneurysm dimensions.
- Open Access
- 9 June 2023
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 18 (11) , 1951-1959
Automatic patient positioning based on robot rotational workspace for extended reality
Purpose: Understanding the properties and aspects of the robotic system is essential to a successful medical intervention, as different capabilities and limits characterize each. Robot positioning is a crucial step in the surgical setup that ensures proper reachability to the desired port locations and facilitates docking procedures. This very demanding task requires much experience to master, especially with multiple trocars, increasing the barrier of entry for surgeons in training. Methods: Previously, we demonstrated an Augmented Reality-based system to visualize the rotational workspace of the robotic system and proved it helps the surgical staff to optimize patient positioning for single-port interventions. In this work, we implemented a new algorithm to allow for an automatic, real-time robotic arm positioning for multiple ports. Results: Our system, based on the rotational workspace data of the robotic arm and the set of trocar locations, can calculate the optimal position of the robotic arm in milliseconds for the positional and in seconds for the rotational workspace in virtual and augmented reality setups. Conclusions: Following the previous work, we extended our system to support multiple ports to cover a broader range of surgical procedures and introduced the automatic positioning component. Our solution can decrease the surgical setup time and eliminate the need to repositioning the robot mid-procedure and is suitable both for the preoperative planning step using VR and in the operating room—running on an AR headset.
- 9 June 2023
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 18 (11) , 1951-1959
Open AccessAutomatic patient positioning based on robot rotational workspace for extended reality
Purpose: Understanding the properties and aspects of the robotic system is essential to a successful medical intervention, as different capabilities and limits characterize each. Robot positioning is a crucial step in the surgical setup that ensures proper reachability to the desired port locations and facilitates docking procedures. This very demanding task requires much experience to master, especially with multiple trocars, increasing the barrier of entry for surgeons in training. Methods: Previously, we demonstrated an Augmented Reality-based system to visualize the rotational workspace of the robotic system and proved it helps the surgical staff to optimize patient positioning for single-port interventions. In this work, we implemented a new algorithm to allow for an automatic, real-time robotic arm positioning for multiple ports. Results: Our system, based on the rotational workspace data of the robotic arm and the set of trocar locations, can calculate the optimal position of the robotic arm in milliseconds for the positional and in seconds for the rotational workspace in virtual and augmented reality setups. Conclusions: Following the previous work, we extended our system to support multiple ports to cover a broader range of surgical procedures and introduced the automatic positioning component. Our solution can decrease the surgical setup time and eliminate the need to repositioning the robot mid-procedure and is suitable both for the preoperative planning step using VR and in the operating room—running on an AR headset.
- Open Access
- 21 September 2020
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 15 (11) , 1797-1805
Force quantification and simulation of pedicle screw tract palpation using direct visuo-haptic volume rendering
Purpose: We present a feasibility study for the visuo-haptic simulation of pedicle screw tract palpation in virtual reality, using an approach that requires no manual processing or segmentation of the volumetric medical data set.Methods: In a first experiment, we quantified the forces and torques present during the palpation of a pedicle screw tract in a real boar vertebra. We equipped a ball-tipped pedicle probe with a 6-axis force/torque sensor and a motion capture marker cluster. We simultaneously recorded the pose of the probe relative to the vertebra and measured the generated forces and torques during palpation. This allowed us replaying the recorded palpation movements in our simulator and to fine-tune the haptic rendering to approximate the measured forces and torques. In a second experiment, we asked two neurosurgeons to palpate a virtual version of the same vertebra in our simulator, while we logged the forces and torques sent to the haptic device.Results: In the experiments with the real vertebra, the maximum measured force along the longitudinal axis of the probe was 7.78 N and the maximum measured bending torque was 0.13 Nm. In an offline simulation of the motion of the pedicle probe recorded during the palpation of a real pedicle screw tract, our approach generated forces and torques that were similar in magnitude and progression to the measured ones. When surgeons tested our simulator, the distributions of the computed forces and torques were similar to the measured ones; however, higher forces and torques occurred more frequently.Conclusions: We demonstrated the suitability of direct visual and haptic volume rendering to simulate a specific surgical procedure. Our approach of fine-tuning the simulation by measuring the forces and torques that are prevalent while palpating a real vertebra produced promising results.
- 21 September 2020
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 15 (11) , 1797-1805
Open AccessForce quantification and simulation of pedicle screw tract palpation using direct visuo-haptic volume rendering
Purpose: We present a feasibility study for the visuo-haptic simulation of pedicle screw tract palpation in virtual reality, using an approach that requires no manual processing or segmentation of the volumetric medical data set.Methods: In a first experiment, we quantified the forces and torques present during the palpation of a pedicle screw tract in a real boar vertebra. We equipped a ball-tipped pedicle probe with a 6-axis force/torque sensor and a motion capture marker cluster. We simultaneously recorded the pose of the probe relative to the vertebra and measured the generated forces and torques during palpation. This allowed us replaying the recorded palpation movements in our simulator and to fine-tune the haptic rendering to approximate the measured forces and torques. In a second experiment, we asked two neurosurgeons to palpate a virtual version of the same vertebra in our simulator, while we logged the forces and torques sent to the haptic device.Results: In the experiments with the real vertebra, the maximum measured force along the longitudinal axis of the probe was 7.78 N and the maximum measured bending torque was 0.13 Nm. In an offline simulation of the motion of the pedicle probe recorded during the palpation of a real pedicle screw tract, our approach generated forces and torques that were similar in magnitude and progression to the measured ones. When surgeons tested our simulator, the distributions of the computed forces and torques were similar to the measured ones; however, higher forces and torques occurred more frequently.Conclusions: We demonstrated the suitability of direct visual and haptic volume rendering to simulate a specific surgical procedure. Our approach of fine-tuning the simulation by measuring the forces and torques that are prevalent while palpating a real vertebra produced promising results.
- 10 October 2019
- Published by Springer Nature
- p. 29-37
Direct Visual and Haptic Volume Rendering of Medical Data Sets for an Immersive Exploration in Virtual Reality
- 10 October 2019
- Published by Springer Nature
- p. 29-37
Direct Visual and Haptic Volume Rendering of Medical Data Sets for an Immersive Exploration in Virtual Reality