HKHenry John Krumb

Henry John Krumb

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Henry John Krumb has a total of 19 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Patronus: patient-specific training setup for aortic aneurysm repair

    by Henry John Krumb, Bernhard Dorweiler, Anirban Mukhopadhyay

    Purpose: Surgical training for Aortic Repair (EVAR) on simulators holds the potential to reduce radiation of the X-ray-guided procedure. Precision and realism of training simulators increases significantly with the use of patient-specific phantoms. However, radiation-free setups utilizing 3D-printed anatomies lack realistic imaging. Method: We propose PATRONUS, a hardware and software prototype for patient-specific, radiation-free surgical training for EVAR. 3D printed, transparent phantoms are imaged inside a black box which is accessed from the outside. Pseudo X-rays are generated through reconstructed radiographs, which are enhanced by virtual catheters and contrast agent. Results: Our prototype demonstrates a complete pipeline including a 3D printing workflow, phantom preparation, online registration of phantoms to the patient CT and pseudo X-ray generation. We report an average registration error (RMSE) of the scene inside the simulator to the digital twin of $${9.30}\,\hbox {mm}$$ 9.30 mm . The entire simulator pipeline takes $${1.059}\,\hbox {s}$$ 1.059 s to execute per image. Conclusion: State-of-the-art techniques for scene understanding and 3D printing enable the transition from simulated interventions on 3D printed vascular phantoms under cameras to a digital twin representation in the CT regime. The PATRONUS simulator prototype thus provides a foundation for radiation-free, realistic endovascular surgical training with patient-specific phantoms.

  • KI-gestützte Navigation in der endovaskulären Chirurgie und Echtzeit-Bildanalyse

    by Henry J. Krumb, Anirban Mukhopadhyay, Bernhard Dorweiler

  • FDA’s PCCP: Opportunities and Gaps

    by Niklas Babendererde, Amin Ranem, Moritz Fuchs, Camila González, Henry John Krumb, Anirban Mukhopadhyay


  • Open Access

    eNCApsulate: neural cellular automata for precision diagnosis on capsule endoscopes

    by Henry John Krumb, Anirban Mukhopadhyay

    Purpose: Wireless capsule endoscopy (WCE) is a noninvasive imaging method for the entire gastrointestinal tract and is a pain-free alternative to traditional endoscopy. It generates extensive video data that requires significant review time, and localizing the capsule after ingestion is a challenge. Techniques like bleeding detection and depth estimation can help with localization of pathologies, but deep learning models are typically too large to run directly on the capsule. Methods: Neural cellular automata (NCAs) for bleeding segmentation and depth estimation are trained on capsule endoscopic images. For monocular depth estimation, we distill a large foundation model into the lean NCA architecture, by treating the outputs of the foundation model as pseudo-ground truth. We then port the trained NCAs to the ESP32 microcontroller, enabling efficient image processing on hardware as small as a camera capsule. Results: NCAs are more accurate (Dice) than other portable segmentation models, while requiring more than 100x fewer parameters stored in memory than other small-scale models. The visual results of NCAs depth estimation look convincing and in some cases beat the realism and detail of the pseudo-ground truth. Runtime optimizations on the ESP32-S3 accelerate the average inference speed significantly, by more than factor 3. Conclusion: With several algorithmic adjustments and distillation, it is possible to eNCApsulate NCA models into microcontrollers that fit into wireless capsule endoscopes. This is the first work that enables reliable bleeding segmentation and depth estimation on a miniaturized device, paving the way for precise diagnosis combined with visual odometry as a means of precise localization of the capsule—on the capsule.


  • Cryotrack: Planning and Navigation for Computer Assisted Cryoablation

    by Henry J. Krumb, Jonas Mehtali, Juan Verde, Anirban Mukhopadhyay, Caroline Essert


  • Open Access

    HEX: a safe research framework for hybrid EMT X-ray navigation

    by Henry J. Krumb, Bernhard Dorweiler, Anirban Mukhopadhyay

    Purpose: Navigating with continuous X-ray provides visual guidance, but exposes both surgeon and patient to ionizing radiation, which is associated with serious health risks. Interleaving fluoro snapshots with electromagnetic tracking (EMT) potentially minimizes radiation. Methods: We propose hybrid EMT + X-ray (HEX), a research framework for navigation with an emphasis on safe experimentation. HEX is based on several hardware and software components that are orchestrated to allow for safe and efficient data acquisition. Results: In our study, hybrid navigation reduces radiation by $$71\%$$ 71 % with cubic, and by $$40\%$$ 40 % with linear error compensation while achieving submillimeter accuracy. Training points for compensation can be reduced by half while keeping a similar accuracy–radiation trade-off. Conclusion: The HEX framework allows to safely and efficiently evaluate the hybrid navigation approach in simulated procedures. Complementing intraoperative X-ray with EMT significantly reduces radiation in the OR, increasing the safety of patients and surgeons.


  • Open Access

    CycleGAN for interpretable online EMT compensation

    by Henry Krumb, Dhritimaan Das, Romol Chadda, Anirban Mukhopadhyay

    Purpose: Electromagnetic tracking (EMT) can partially replace X-ray guidance in minimally invasive procedures, reducing radiation in the OR. However, in this hybrid setting, EMT is disturbed by metallic distortion caused by the X-ray device. We plan to make hybrid navigation clinical reality to reduce radiation exposure for patients and surgeons, by compensating EMT error. Methods: Our online compensation strategy exploits cycle-consistent generative adversarial neural networks (CycleGAN). Positions are translated from various bedside environments to their bench equivalents, by adjusting their z-component. Domain-translated points are fine-tuned on the x–y plane to reduce error in the bench domain. We evaluate our compensation approach in a phantom experiment. Results: Since the domain-translation approach maps distorted points to their laboratory equivalents, predictions are consistent among different C-arm environments. Error is successfully reduced in all evaluation environments. Our qualitative phantom experiment demonstrates that our approach generalizes well to an unseen C-arm environment. Conclusion: Adversarial, cycle-consistent training is an explicable, consistent and thus interpretable approach for online error compensation. Qualitative assessment of EMT error compensation gives a glimpse to the potential of our method for rotational error compensation.


  • Open Access

    Leveraging spatial uncertainty for online error compensation in EMT

    by Henry Krumb, Sofie Hofmann, David Kügler, Ahmed Ghazy, Bernhard Dorweiler, Judith Bredemann, Robert Schmitt, Georgios Sakas, Anirban Mukhopadhyay

    Purpose: Electromagnetic tracking (EMT) can potentially complement fluoroscopic navigation, reducing radiation exposure in a hybrid setting. Due to the susceptibility to external distortions, systematic error in EMT needs to be compensated algorithmically. Compensation algorithms for EMT in guidewire procedures are only practical in an online setting. Methods: We collect positional data and train a symmetric artificial neural network (ANN) architecture for compensating navigation error. The results are evaluated in both online and offline scenarios and are compared to polynomial fits. We assess spatial uncertainty of the compensation proposed by the ANN. Simulations based on real data show how this uncertainty measure can be utilized to improve accuracy and limit radiation exposure in hybrid navigation. Results: ANNs compensate unseen distortions by more than 70%, outperforming polynomial regression. Working on known distortions, ANNs outperform polynomials as well. We empirically demonstrate a linear relationship between tracking accuracy and model uncertainty. The effectiveness of hybrid tracking is shown in a simulation experiment. Conclusion: ANNs are suitable for EMT error compensation and can generalize across unseen distortions. Model uncertainty needs to be assessed when spatial error compensation algorithms are developed, so that training data collection can be optimized. Finally, we find that error compensation in EMT reduces the need for X-ray images in hybrid navigation.


  • Open Access

    Leveraging Spatial Uncertainty for Online Error Compensation in EMT

    by Henry Krumb, Sofie Hofmann, David Kügler, Ahmed Ghazy, Bernhard Dorweiler, Robert Schmitt, Georgios Sakas, Anirban Mukhopadhyay

    Purpose: Electromagnetic Tracking (EMT) can potentially complement fluoroscopic navigation, reducing radiation exposure in a hybrid setting. Due to the susceptibility to external distortions, systematic error in EMT needs to be compensated algorithmically. Compensation algorithms for EMT in guidewire procedures are only practical in an online setting. Methods: We collect positional data and train a symmetric Artificial Neural Network (ANN) architecture for compensating navigation error. The results are evaluated in both online and offline scenarios and are compared to polynomial fits. We assess spatial uncertainty of the compensation proposed by the ANN. Simulations based on real data show how this uncertainty measure can be utilized to improve accuracy and limit radiation exposure in hybrid navigation. Results: ANNs compensate unseen distortions by more than 70%, outperforming polynomial regression. Working on known distortions, ANNs outperform polynomials as well. We empirically demonstrate a linear relationship between tracking accuracy and model uncertainty. The effectiveness of hybrid tracking is shown in a simulation experiment. Conclusion: ANNs are suitable for EMT error compensation and can generalize across unseen distortions. Model uncertainty needs to be assessed when spatial error compensation algorithms are developed, so that training data collection can be optimized. Finally, we find that error compensation in EMT reduces the need for x-ray images in hybrid navigation.