Henry John Krumb
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Henry John Krumb has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
Anirban Mukhopadhyay
Computer Science Department, TU Darmstadt, Fraunhoferstr. 5, Darmstadt, 64293, Hessen, Germany
6 shared publicationsBernhard Dorweiler
Klinik und Poliklinik für Gefäßchirurgie- Vaskuläre und endovaskuläre Chirurgie, Uniklinik Köln, Kerpener Str. 62, Cologne, 50937, Nordrhein-Westfalen, Germany
4 shared publications- Anirban Mukhopadhyay
TU Darmstadt, Darmstadt, Germany
3 shared publications Ahmed Ghazy
Klinik für Herz-, Thorax- und Gefäßchirurgie, Universitätsmedizin Mainz, Mainz, Germany
2 shared publicationsDavid Kügler
DZNE Bonn, Bonn, Germany
2 shared publicationsGeorgios Sakas
Department of Computer Science, Technische Universität Darmstadt, Darmstadt, Germany
2 shared publications
Latest Publications
- Open Access
- 3 June 2026
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 21 (7) , 1505-1513
Patronus: patient-specific training setup for aortic aneurysm repair
Purpose: Surgical training for Aortic Repair (EVAR) on simulators holds the potential to reduce radiation of the X-ray-guided procedure. Precision and realism of training simulators increases significantly with the use of patient-specific phantoms. However, radiation-free setups utilizing 3D-printed anatomies lack realistic imaging. Method: We propose PATRONUS, a hardware and software prototype for patient-specific, radiation-free surgical training for EVAR. 3D printed, transparent phantoms are imaged inside a black box which is accessed from the outside. Pseudo X-rays are generated through reconstructed radiographs, which are enhanced by virtual catheters and contrast agent. Results: Our prototype demonstrates a complete pipeline including a 3D printing workflow, phantom preparation, online registration of phantoms to the patient CT and pseudo X-ray generation. We report an average registration error (RMSE) of the scene inside the simulator to the digital twin of $${9.30}\,\hbox {mm}$$ . The entire simulator pipeline takes $${1.059}\,\hbox {s}$$ to execute per image. Conclusion: State-of-the-art techniques for scene understanding and 3D printing enable the transition from simulated interventions on 3D printed vascular phantoms under cameras to a digital twin representation in the CT regime. The PATRONUS simulator prototype thus provides a foundation for radiation-free, realistic endovascular surgical training with patient-specific phantoms.- 3 June 2026
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 21 (7) , 1505-1513
Open AccessPatronus: patient-specific training setup for aortic aneurysm repair
Purpose: Surgical training for Aortic Repair (EVAR) on simulators holds the potential to reduce radiation of the X-ray-guided procedure. Precision and realism of training simulators increases significantly with the use of patient-specific phantoms. However, radiation-free setups utilizing 3D-printed anatomies lack realistic imaging. Method: We propose PATRONUS, a hardware and software prototype for patient-specific, radiation-free surgical training for EVAR. 3D printed, transparent phantoms are imaged inside a black box which is accessed from the outside. Pseudo X-rays are generated through reconstructed radiographs, which are enhanced by virtual catheters and contrast agent. Results: Our prototype demonstrates a complete pipeline including a 3D printing workflow, phantom preparation, online registration of phantoms to the patient CT and pseudo X-ray generation. We report an average registration error (RMSE) of the scene inside the simulator to the digital twin of $${9.30}\,\hbox {mm}$$ . The entire simulator pipeline takes $${1.059}\,\hbox {s}$$ to execute per image. Conclusion: State-of-the-art techniques for scene understanding and 3D printing enable the transition from simulated interventions on 3D printed vascular phantoms under cameras to a digital twin representation in the CT regime. The PATRONUS simulator prototype thus provides a foundation for radiation-free, realistic endovascular surgical training with patient-specific phantoms. - 15 January 2026
- Published by Springer Nature in Gefässchirurgie
- Vol. 31 (2) , 112-116
KI-gestützte Navigation in der endovaskulären Chirurgie und Echtzeit-Bildanalyse
- 15 January 2026
- Published by Springer Nature in Gefässchirurgie
- Vol. 31 (2) , 112-116
KI-gestützte Navigation in der endovaskulären Chirurgie und Echtzeit-Bildanalyse
- Open Access
- 4 July 2025
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 21 (1) , 195-202
eNCApsulate: neural cellular automata for precision diagnosis on capsule endoscopes
Purpose: Wireless capsule endoscopy (WCE) is a noninvasive imaging method for the entire gastrointestinal tract and is a pain-free alternative to traditional endoscopy. It generates extensive video data that requires significant review time, and localizing the capsule after ingestion is a challenge. Techniques like bleeding detection and depth estimation can help with localization of pathologies, but deep learning models are typically too large to run directly on the capsule. Methods: Neural cellular automata (NCAs) for bleeding segmentation and depth estimation are trained on capsule endoscopic images. For monocular depth estimation, we distill a large foundation model into the lean NCA architecture, by treating the outputs of the foundation model as pseudo-ground truth. We then port the trained NCAs to the ESP32 microcontroller, enabling efficient image processing on hardware as small as a camera capsule. Results: NCAs are more accurate (Dice) than other portable segmentation models, while requiring more than 100x fewer parameters stored in memory than other small-scale models. The visual results of NCAs depth estimation look convincing and in some cases beat the realism and detail of the pseudo-ground truth. Runtime optimizations on the ESP32-S3 accelerate the average inference speed significantly, by more than factor 3. Conclusion: With several algorithmic adjustments and distillation, it is possible to eNCApsulate NCA models into microcontrollers that fit into wireless capsule endoscopes. This is the first work that enables reliable bleeding segmentation and depth estimation on a miniaturized device, paving the way for precise diagnosis combined with visual odometry as a means of precise localization of the capsule—on the capsule.
- 4 July 2025
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 21 (1) , 195-202
Open AccesseNCApsulate: neural cellular automata for precision diagnosis on capsule endoscopes
Purpose: Wireless capsule endoscopy (WCE) is a noninvasive imaging method for the entire gastrointestinal tract and is a pain-free alternative to traditional endoscopy. It generates extensive video data that requires significant review time, and localizing the capsule after ingestion is a challenge. Techniques like bleeding detection and depth estimation can help with localization of pathologies, but deep learning models are typically too large to run directly on the capsule. Methods: Neural cellular automata (NCAs) for bleeding segmentation and depth estimation are trained on capsule endoscopic images. For monocular depth estimation, we distill a large foundation model into the lean NCA architecture, by treating the outputs of the foundation model as pseudo-ground truth. We then port the trained NCAs to the ESP32 microcontroller, enabling efficient image processing on hardware as small as a camera capsule. Results: NCAs are more accurate (Dice) than other portable segmentation models, while requiring more than 100x fewer parameters stored in memory than other small-scale models. The visual results of NCAs depth estimation look convincing and in some cases beat the realism and detail of the pseudo-ground truth. Runtime optimizations on the ESP32-S3 accelerate the average inference speed significantly, by more than factor 3. Conclusion: With several algorithmic adjustments and distillation, it is possible to eNCApsulate NCA models into microcontrollers that fit into wireless capsule endoscopes. This is the first work that enables reliable bleeding segmentation and depth estimation on a miniaturized device, paving the way for precise diagnosis combined with visual odometry as a means of precise localization of the capsule—on the capsule.
- 3 October 2024
- Published by Springer Nature
- p. 99-108
Cryotrack: Planning and Navigation for Computer Assisted Cryoablation
- 3 October 2024
- Published by Springer Nature
- p. 99-108
Cryotrack: Planning and Navigation for Computer Assisted Cryoablation
- Open Access
- 12 May 2023
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 18 (7) , 1175-1183
HEX: a safe research framework for hybrid EMT X-ray navigation
Purpose: Navigating with continuous X-ray provides visual guidance, but exposes both surgeon and patient to ionizing radiation, which is associated with serious health risks. Interleaving fluoro snapshots with electromagnetic tracking (EMT) potentially minimizes radiation. Methods: We propose hybrid EMT + X-ray (HEX), a research framework for navigation with an emphasis on safe experimentation. HEX is based on several hardware and software components that are orchestrated to allow for safe and efficient data acquisition. Results: In our study, hybrid navigation reduces radiation by $$71\%$$ with cubic, and by $$40\%$$ with linear error compensation while achieving submillimeter accuracy. Training points for compensation can be reduced by half while keeping a similar accuracy–radiation trade-off. Conclusion: The HEX framework allows to safely and efficiently evaluate the hybrid navigation approach in simulated procedures. Complementing intraoperative X-ray with EMT significantly reduces radiation in the OR, increasing the safety of patients and surgeons.- 12 May 2023
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 18 (7) , 1175-1183
Open AccessHEX: a safe research framework for hybrid EMT X-ray navigation
Purpose: Navigating with continuous X-ray provides visual guidance, but exposes both surgeon and patient to ionizing radiation, which is associated with serious health risks. Interleaving fluoro snapshots with electromagnetic tracking (EMT) potentially minimizes radiation. Methods: We propose hybrid EMT + X-ray (HEX), a research framework for navigation with an emphasis on safe experimentation. HEX is based on several hardware and software components that are orchestrated to allow for safe and efficient data acquisition. Results: In our study, hybrid navigation reduces radiation by $$71\%$$ with cubic, and by $$40\%$$ with linear error compensation while achieving submillimeter accuracy. Training points for compensation can be reduced by half while keeping a similar accuracy–radiation trade-off. Conclusion: The HEX framework allows to safely and efficiently evaluate the hybrid navigation approach in simulated procedures. Complementing intraoperative X-ray with EMT significantly reduces radiation in the OR, increasing the safety of patients and surgeons. - Open Access
- 14 March 2021
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 16 (5) , 757-765
CycleGAN for interpretable online EMT compensation
Purpose: Electromagnetic tracking (EMT) can partially replace X-ray guidance in minimally invasive procedures, reducing radiation in the OR. However, in this hybrid setting, EMT is disturbed by metallic distortion caused by the X-ray device. We plan to make hybrid navigation clinical reality to reduce radiation exposure for patients and surgeons, by compensating EMT error. Methods: Our online compensation strategy exploits cycle-consistent generative adversarial neural networks (CycleGAN). Positions are translated from various bedside environments to their bench equivalents, by adjusting their z-component. Domain-translated points are fine-tuned on the x–y plane to reduce error in the bench domain. We evaluate our compensation approach in a phantom experiment. Results: Since the domain-translation approach maps distorted points to their laboratory equivalents, predictions are consistent among different C-arm environments. Error is successfully reduced in all evaluation environments. Our qualitative phantom experiment demonstrates that our approach generalizes well to an unseen C-arm environment. Conclusion: Adversarial, cycle-consistent training is an explicable, consistent and thus interpretable approach for online error compensation. Qualitative assessment of EMT error compensation gives a glimpse to the potential of our method for rotational error compensation.
- 14 March 2021
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 16 (5) , 757-765
Open AccessCycleGAN for interpretable online EMT compensation
Purpose: Electromagnetic tracking (EMT) can partially replace X-ray guidance in minimally invasive procedures, reducing radiation in the OR. However, in this hybrid setting, EMT is disturbed by metallic distortion caused by the X-ray device. We plan to make hybrid navigation clinical reality to reduce radiation exposure for patients and surgeons, by compensating EMT error. Methods: Our online compensation strategy exploits cycle-consistent generative adversarial neural networks (CycleGAN). Positions are translated from various bedside environments to their bench equivalents, by adjusting their z-component. Domain-translated points are fine-tuned on the x–y plane to reduce error in the bench domain. We evaluate our compensation approach in a phantom experiment. Results: Since the domain-translation approach maps distorted points to their laboratory equivalents, predictions are consistent among different C-arm environments. Error is successfully reduced in all evaluation environments. Our qualitative phantom experiment demonstrates that our approach generalizes well to an unseen C-arm environment. Conclusion: Adversarial, cycle-consistent training is an explicable, consistent and thus interpretable approach for online error compensation. Qualitative assessment of EMT error compensation gives a glimpse to the potential of our method for rotational error compensation.
- Open Access
- 22 May 2020
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 15 (6) , 1043-1051
Leveraging spatial uncertainty for online error compensation in EMT
Purpose: Electromagnetic tracking (EMT) can potentially complement fluoroscopic navigation, reducing radiation exposure in a hybrid setting. Due to the susceptibility to external distortions, systematic error in EMT needs to be compensated algorithmically. Compensation algorithms for EMT in guidewire procedures are only practical in an online setting. Methods: We collect positional data and train a symmetric artificial neural network (ANN) architecture for compensating navigation error. The results are evaluated in both online and offline scenarios and are compared to polynomial fits. We assess spatial uncertainty of the compensation proposed by the ANN. Simulations based on real data show how this uncertainty measure can be utilized to improve accuracy and limit radiation exposure in hybrid navigation. Results: ANNs compensate unseen distortions by more than 70%, outperforming polynomial regression. Working on known distortions, ANNs outperform polynomials as well. We empirically demonstrate a linear relationship between tracking accuracy and model uncertainty. The effectiveness of hybrid tracking is shown in a simulation experiment. Conclusion: ANNs are suitable for EMT error compensation and can generalize across unseen distortions. Model uncertainty needs to be assessed when spatial error compensation algorithms are developed, so that training data collection can be optimized. Finally, we find that error compensation in EMT reduces the need for X-ray images in hybrid navigation.
- 22 May 2020
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 15 (6) , 1043-1051
Open AccessLeveraging spatial uncertainty for online error compensation in EMT
Purpose: Electromagnetic tracking (EMT) can potentially complement fluoroscopic navigation, reducing radiation exposure in a hybrid setting. Due to the susceptibility to external distortions, systematic error in EMT needs to be compensated algorithmically. Compensation algorithms for EMT in guidewire procedures are only practical in an online setting. Methods: We collect positional data and train a symmetric artificial neural network (ANN) architecture for compensating navigation error. The results are evaluated in both online and offline scenarios and are compared to polynomial fits. We assess spatial uncertainty of the compensation proposed by the ANN. Simulations based on real data show how this uncertainty measure can be utilized to improve accuracy and limit radiation exposure in hybrid navigation. Results: ANNs compensate unseen distortions by more than 70%, outperforming polynomial regression. Working on known distortions, ANNs outperform polynomials as well. We empirically demonstrate a linear relationship between tracking accuracy and model uncertainty. The effectiveness of hybrid tracking is shown in a simulation experiment. Conclusion: ANNs are suitable for EMT error compensation and can generalize across unseen distortions. Model uncertainty needs to be assessed when spatial error compensation algorithms are developed, so that training data collection can be optimized. Finally, we find that error compensation in EMT reduces the need for X-ray images in hybrid navigation.
- Open Access
Leveraging Spatial Uncertainty for Online Error Compensation in EMT
Purpose: Electromagnetic Tracking (EMT) can potentially complement fluoroscopic navigation, reducing radiation exposure in a hybrid setting. Due to the susceptibility to external distortions, systematic error in EMT needs to be compensated algorithmically. Compensation algorithms for EMT in guidewire procedures are only practical in an online setting. Methods: We collect positional data and train a symmetric Artificial Neural Network (ANN) architecture for compensating navigation error. The results are evaluated in both online and offline scenarios and are compared to polynomial fits. We assess spatial uncertainty of the compensation proposed by the ANN. Simulations based on real data show how this uncertainty measure can be utilized to improve accuracy and limit radiation exposure in hybrid navigation. Results: ANNs compensate unseen distortions by more than 70%, outperforming polynomial regression. Working on known distortions, ANNs outperform polynomials as well. We empirically demonstrate a linear relationship between tracking accuracy and model uncertainty. The effectiveness of hybrid tracking is shown in a simulation experiment. Conclusion: ANNs are suitable for EMT error compensation and can generalize across unseen distortions. Model uncertainty needs to be assessed when spatial error compensation algorithms are developed, so that training data collection can be optimized. Finally, we find that error compensation in EMT reduces the need for x-ray images in hybrid navigation.
Open AccessLeveraging Spatial Uncertainty for Online Error Compensation in EMT
Purpose: Electromagnetic Tracking (EMT) can potentially complement fluoroscopic navigation, reducing radiation exposure in a hybrid setting. Due to the susceptibility to external distortions, systematic error in EMT needs to be compensated algorithmically. Compensation algorithms for EMT in guidewire procedures are only practical in an online setting. Methods: We collect positional data and train a symmetric Artificial Neural Network (ANN) architecture for compensating navigation error. The results are evaluated in both online and offline scenarios and are compared to polynomial fits. We assess spatial uncertainty of the compensation proposed by the ANN. Simulations based on real data show how this uncertainty measure can be utilized to improve accuracy and limit radiation exposure in hybrid navigation. Results: ANNs compensate unseen distortions by more than 70%, outperforming polynomial regression. Working on known distortions, ANNs outperform polynomials as well. We empirically demonstrate a linear relationship between tracking accuracy and model uncertainty. The effectiveness of hybrid tracking is shown in a simulation experiment. Conclusion: ANNs are suitable for EMT error compensation and can generalize across unseen distortions. Model uncertainty needs to be assessed when spatial error compensation algorithms are developed, so that training data collection can be optimized. Finally, we find that error compensation in EMT reduces the need for x-ray images in hybrid navigation.